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The Internet is changing the way of life 
The Internet will change the way of control 
For researchers devoted to Networked Control Systems 



Preface 



In the last decade, network technology has dramatically been developed. Re- 
cently, more and more network technologies have been applied to control 
systems. Now, networked control is a new area in control systems. Particu- 
larly, Internet based control systems allow remote monitoring and adjustment 
of plants over the Internet, which makes the control systems benefit from the 
ways of retrieving data and reacting to plant fluctuations from anywhere 
around the world at any time. The networked control has also opened up 
a complete new range of real-world applications, namely tele-manufacturing, 
tele-surgery, museum guidance, traffic control, space exploration, disaster res- 
cue, and health care. In recent years, the techniques of Internet of Things are 
developed rapidly, the research of networked control systems (NCSs) plays a 
key role in Internet of Things. 

In NCSs, the plant, controller, sensor, actuator and reference command are 
connected through networks. As the structure of NCSs is different from that 
of tradition control systems, there exist various specific problems in NCSs, for 
example, quantization, network delay, loss of data packets, network security 
and safety. Therefore, analysis and synthesis of NCSs are of great importance. 

The first chapter of this book is an overview of recent development of 
NCSs, which is concluded in Chapter 1. 

Then, this book will present four parts: 

Part I: Some development of quantization has been introduced and new 
results on quantization over networks are given. In Chapter 2, a simple quan- 
tization strategy is proposed and the feedback control is designed based on 
quantized estimated states sent through network. In Chapter 3, the problem 
of the mean square stability of linear discrete systems with quantization and 
packet dropout is considered. The quantizer used in this chapter is uniform 
quantizer and the packet dropout rate is important to the performance of 
system. The Lyapunov method and "zoom" strategy are used to guaran- 
tee the mean square stability of the discrete linear systems. In Chapter 4, 
the stability of a quantized system is considered, which is based on a quan- 
tized input computed from quantized measurements. The problem of globally 
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asymptotic stability of the system is transferred to the one of an equivalent 
system depending on a multiplier which is nonnegative and boundness. It is 
the focus of this chapter to discuss the nonnegative and boundness of mul- 
tiplier. A sufficient condition is given for the globally asymptotic stability of 
the system. 

Part II: New results on data fusion over networks are presented. In Chapter 
5, the method of the state estimation algorithm in single channel is extended 
to multi-channel. Each channel is with a different packet arrival statistics. 
The arrival process via a random variable is modeled and two different data 
fusion architectures with finite buffer are proposed. The optimal state esti- 
mation for a kind of linear dynamic systems with the observations obtained 
asynchronously with multiple rates is concerned in Chapter 6, where the ob- 
servations may lose randomly. For each sensor, a rule is proposed to check out 
whether the measurement is missing. With the help of the modified Kalman 
filter, the multiscale system theory and the federated square root filter, the 
optimal state estimate is obtained at the highest sampling rate given. 

Part III: Most work have ignored another important feature of NCSs. This 
feature is that the communication networks can transmit a packet of data at 
the same time, which is not done in traditional control systems. Therefore, 
in Chapter 7, the network feature is made full use of and a new networked 
predictive control scheme is proposed, which can overcome the effects caused 
by network data dropout modeled as Markov chain. In Chapter 8, an optimal 
estimation method is proposed to overcome the time delay and data dropout 
in the feedback channel. There is a buffer to store the data from the sensor 
and the length of the buffer can be set to store the data in this step and 
before. 

Part IV: With the development of NCSs, the research of fault detection 
over networks is of great interest. In Chapter 9, a more general case that the 
fault detection center is neither located at the controller node nor located 
at the plant node is considered, all the input data and measurement data 
arc transmitted from the actuator node and the sensor node to the fault 
detection center, respectively, over unreliable networks with bounded packet 
loss. The bounded packet loss is modeled in two ways: arbitrary packet loss 
process and Markovian packet loss process. The stability analysis of the er- 
ror system and the design of fault detection filter (FDF) gains are given to 
satisfy some performance constraints. In Chapter 10, a fault detection and 
compensation scheme based likelihood ratios for networked predictive control 
systems with random time delay and clock asynchronism is considered. A pre- 
dictive control scheme based on state observer is designed to compensate the 
network-induced time delay. The measured outputs of plant are sent back to 
the local node with a buffer. The likelihood ratios of fault are computed, and 
if a fault is detected and identified, the estimate of the fault is sent to the 
controller to compensate the fault. 

We would like to acknowledge the collaborations with Dr. Liping Yan on 
the work of multisensor data fusion reported in the monograph and PH.D 
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Symbols and Acronyms 



A system matrix 

A^ 1 inverse of matrix A 

A T transpose of matrix A 

A > symmetric positive semi-definite 

A > symmetric positive definite 

A < symmetric negative semi-definite 

A < symmetric negative definite 

C field of complex numbers 

Ci measurement matrix 

dct(A) determinant of matrix A 

diag(Xi, X2, • • • , X m ) diagonal matrix with Xi as its ith diagonal element 

/ identity matrix 

lim limit 

LMI linear matrix inequality 

P(k\k) the covariance of x{k\k) 

Pi(k\k) the covariance of Xi(k\k) 

i-V(fc|fc) the estimation error covariance of x(k) based on Sensor N under 

the ideal assumption that without any measurements missing. 

P N \ [i (k\k) the covariance of Xff^(k\k) 

PN\ij{k\k) the cross-covariance between x^v|j(A;|fc) and Xjy\j(k\k) 

rank(A) rank of matrix A 

R field of real numbers 

R n n-dimensional real Euclidean space 

i? nxm space ofnxm real matrices 

sgn(x) the sign of x 

Si the sampling rate of Sensor i 

tr(A) trace of matrix A 

T the sampling interval of Sensor iV 

nxm zero matrix of dimension n x m 

\{A) eigenvalue of matrix A 

Amin(^4) minimum eigenvalue of matrix A 
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Amax(^4) maximum eigenvalue of matrix A 

<j{A) singular value of matrix A 

c m in(^4) minimum singular value of matrix A 

Cmax(^4) maximum singular value of matrix A 

\x\ absolute value (or modulus) of x 

||x|| Euclidean norm 

||P|| induced norm supiuii^ ||-Pa;|| 

V for all 

£ belong to 

— > tend to, or mapping to (case sensitive) 

® matrix Kroneckcr product 

£{■} mathematical expectation operator 

U(k) an nN x nN matrix, whose ij-th block is P^uj(k\k) 

sup supremum 

inf infimum 

ALB E{AB T } = 

6kj Kronecker delta function 

x{k) the state variable vector at time kT 

w(k) process noise, meet iV(0, Q) 

Xi(k) the state variable vector at Scale i 

yi{k) the fc-th measurement observed by Sensor i 

7i(fc) a stochastic sequence that takes values on 1 and with Bernoulli 
distribution, which is used to describe the missing of measureme- 
nts of Sensor i 

Vi(k) measurement noise, meet N(0,Ri) 

x(k\k) the estimation of x(k) based on the measurements observed by 
all the sensors before time kT 

Xi(k\k) the estimation of Xi(k) based on the first to the fc-th measureme- 
nts of Sensor i 

%N\i{k\k) the estimation of x(k) based on the measurements of Sensor i 
observed before time kT 

x(k\k) the estimation error of x(k\k) 

Xi(k\k) the estimation error of Xi(k\k) 

XN\i(k\k) the estimation error of x?f\i(k\k) 
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Chapter 1 
Introduction 



1.1 B ackgr ound 

With the emergence of high speed network technology that allows a clus- 
ter of devices to be linked together economically to form distributed net- 
works which are capable of remote data transmission and data exchanges, 
distributed control systems based on networks are increasing rapidly in var- 
ious applications ( 83, 84J). Due to the use of networks, the complexity and 
the cost of distributed control systems are reduced greatly and the mainte- 
nance of the systems becomes much easier ( [229] ). Because of these attractive 
benefits, many industrial companies and institutes have shown great interest 
in applying various networks to remote control systems and manufacturing 
automation. As a result of extensive research and development, several net- 
work protocols for industrial control have been released, such as industrial 
Ethernet, ControlNet, and DeviceNet. 

The further expansion of the Internet and rapid development of wireless 
network technology will no doubt lead to even wider applications of control 
systems through networks. Through a real-time network, a feedback control 
system can be seen as a NCSs f |189j ) which includes fieldbus control sys- 
tems constructed on the basis of bus technology (e.g., DeviceNet, ControlNet 
and Lon Works) and Internet based on control systems using general com- 
puter networks. NCSs are completely distributed real-time feedback control 
systems, which are integration of sensors, controllers, actuators and commu- 
nication networks. The frame diagram of NCSs can be shown as Fig. 11.11 

The NCSs provide data transmission between devices to ensure that the 
users of different sites can realize resource sharing and coordinating manip- 
ulation, reduce system wiring, make system diagnosis and increase system 
flexibility. But, the insertion of the communication network in the feedback 
control loop makes the analysis and design of NCSs complex. Conventional 
control theories with many ideal assumptions, such as synchronized control 
and non-delayed sensing and actuation, must be re-evaluated before they are 
applied to NCSs. 

Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. l |-ll| 
springerlink.com (§) Springer- Verlag Berlin Heidelberg 2011 
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Fig. 1.1 Networked control system. 



1.2 Internet of Things 

In recent years, the Internet of Things is a hot research area. It is a technolog- 
ical revolution that represents the future of computing and communications, 
and its development depends on dynamic technical innovation in a number 
of important fields, from wireless sensors to nano-technology. NCSs play a 
key role in the Internet of Things. 



1.2.1 The Origin of Internet of Things 



Over a decade ago, the late Mark Weiser developed a seminal vision of future 
technological ubiquity-one in which the increasing "availability" of processing 
power would be accompanied by its decreasing "visibility" . As he observed, 
"the most profound technologies are those that disappear... they weave them- 
selves into the fabric of everyday life until they are indistinguishable from 
it" . Early forms of ubiquitous information and communication networks are 
evident in the widespread use of mobile phones: the number of mobile phones 
worldwide surpassed 2 billion in mid-2005. These little gadgets have become 
an integral and intimate part of everyday life for many millions of people. 
Today, developments are rapidly under way to take this phenomenon an im- 
portant step further, by embedding short-range mobile transceivers into a 
wide array of additional gadgets and everyday items, enabling new forms of 
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communication between people and things, and between things themselves. 
A new dimension has been added to the world of information and communi- 
cation technologies: from anytime, any place connectivity for anyone, we will 
now have connectivity for anything. 



1.2.2 The Definition of Internet of Things 

Connections will multiply and create an entirely new dynamic network of 
networks-an Internet of Things. The Internet of Things is neither science 
fiction nor industry hype, but is based on solid technological advances and 
visions of network ubiquity that are zealously being realized. Furthermore, 
the technologies of the Internet of Things offer immense potential to con- 
sumers, manufacturers and firms. The Internet of Things refers to a network 
of objects, such as household appliances. It is often a self-configuring wireless 
network. The concept of the Internet of Things is attributed to the original 
Auto-ID Center, founded in 1999 and based at the time in Massachusetts 
Institute of Technology. If all cans, books, shoes or parts of cars are equipped 
with minuscule identifying devices, daily life on our planet will undergo a 
transformation. Things like running out of stock or wasted products will no 
longer exist as we will know exactly what is being consumed on the other 
side of the globe. Theft will be a thing of the past as we will know where a 
product is at all times. The same applies to parcels lost in the post. 



1.2.3 The Meaning of Internet of Things 

In Internet of Things, NCSs play a key role. First, in order to connect every- 
day objects and devices to large databases and networks- and indeed to the 
network of networks (the internet)-a simple, unobtrusive and cost-effective 
system of item identification is crucial. Only then can data about things be 
collected and processed. Radio-frequency identification offers this function- 
ality. Second, data collection will benefit from the ability to detect changes 
in the physical status of things, using sensor technologies. Embedded intelli- 
gence in the things themselves can further enhance the power of the network 
by devolving information processing capabilities to the edges of the network. 
Finally, advances in miniaturization and nano-technology mean that smaller 
and smaller things will have the ability to interact and connect. A combi- 
nation of all of these developments will create an Internet of Things that 
connects the world's objects in both a sensory and an intelligent manner. 
The Internet of Things will draw on the functionality offered by all of these 
technologies to realize the vision of a fully interactive and responsive network 
environment. Fig. ll.2l shows the future applications of the Internet of Things. 
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Fig. 1.2 Internet of Things. 



1.3 Main Issues 



Specifically, the following issues need to be addressed ( |130llTB51 1225] ). 

1) The network-induced delay (sensor-to-controller delay and controller- 
to-actuator delay) occurs while exchanging data among devices connected 
to the shared network, which will be either constant (up to jitter) or time 
varying, can degrade the performance of control systems designed without 
considering the delay and can even destabilize the svstemf [2011 1117| I200J ). 

2) The network can be viewed as a web of unreliable transmission paths. 
Some packets not only suffer transmission delay but, even worse, can be lost 
during transmission. Thus, how such packet dropouts affect the performance 
of a NCS is an issue that must be considered ( [2241 1207| ) . 

3) The plant outputs may be transmitted using multiple network packets 
(so-called multiple packet transmission) due to the bandwidth and packet size 
constraints of the network. Only a part or none of the packets could arrive on 
the controller side because of the arbitrariness of the network medium with 
other nodes on the networkf [1381 177] ). 

4) Stability and robustness analysis for NCSs is challenging since the net- 
work delay varies with network topology, network protocol, network load, 
network bandwidth and package size and its value may be bounded, un- 
bounded, time- varying, constant or random( |116U107l 11121 [PT)5l 111 lj ). There 
also exist several uncertainties in NCSs, e.g., external disturbance, modeling 
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error, system dynamics change. Up to date, some research results have been 
obtained in stability and robustness analysis of systems. 

The problem of robust stabilization for uncertain systems with time-delay has 
been dealt using a number of different approaches, for example, the Riccati 
equation approaches, linear matrix inequality (LMI) approaches, and the 
Lyapunov min-max approaches. In particular, several approaches are applied 
to solve the problems arising in networked linear control systems. 



1.4 Methods 

Generally speaking, there are three types of NCS methods: 

Type 1 - scheduling methods that guarantee network QoS (quality of ser- 
vice); 

Type 2 - control methods that guarantee system QoP (quality of perfor- 
mance); 

Type 3 - integrating scheduling and control methods that consider both 
QoS and QoP. 

For Type 1, the following scheduling methods have been developed: 
scheduling method MEF (Maximum-Error-First) based on MATI (Maximal- 
Allowable- Transfer-Interval) ([155]), a scheduling protocol P-CSMA/CA 
(Prioritized -CSMA-CA) based on IEEE 802.11 wireless standard ([215]). 
and a sampling time scheduling method of network bandwidth allocation and 
sampling period decision for multi-loop NCSs in virtue of the notion "win- 
dow" , namely the service window of each transmission data in network ([73). 

For Type 2, there are many control methods developed for NCS, for ex- 
ample, augmented deterministic discrete-time model method ([64 ), Queuing 
method ([114), optimal control method ( |130l 1113] ). perturbation method 
([189 ), robust control method f [60~l 1220] ). fuzzy logic modulation method 
(EDi event-based method ( [177] ). end- user control adaptation method ( [183) ). 
control under data rate constrains method( [411 1126) ) . 

For Type 3, the following problems have been studied: the optimal sam- 
pling period selection problem for a set of digital controllers (162 ), the 
sampling period optimization problem under the schedulability constraints 
( |147j ). the optimal scheduling problem under both RM-schedulability con- 
straints and NCS stability constraints ( [229) ). and the NCS analysis and 
simulation problem solved by two Matlab-based toolboxes: Jitterbug and 
TrueTime (http://www.control.lth.se/ anton/, 2003). 

In addition, the stability problem of closed-loop NCS in the presence of 
network delays and data packet drops has been addressed in ( [229] ). The sta- 
bility problem of NCSs with stochastic protocols and channels has been stud- 
ied in ( |175j ). The problem of observer and robust state estimation has been 
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addressed in f [153M151] ). To reduce network traffic load, a sampled-data NCS 
scheme has been presented and some necessary and sufficient conditions for 
global exponential stability of the closed-loop systems via state/output feed- 
back without /with network delays have been established in ([121]). Some is- 
sues related to network bandwidth constraints and network traffic congestion 
in NCSs have been studied in ( [Tl IB51 [TO7| ) . Internet based control has also 
been considered for practical applications, for example, Internet-based pro- 
cess control ( |148j ). Internet-based control system as a control device f[54"]). 
Internet robots f [179| ). Internet based multimedia education ( [129] ). process 
monitoring and optimization via the web ( [127) ) and game-theoretic treat- 
ment of distributed power control in CDhlA wireless systems using outage 
probabilities([5]). 



1.5 Problems Studied in This Book 

The following four major issues for NCSs will be studied in this book: quan- 
tization, data fusion, predictive control and fault detection. In fact, because 
of the joint of network, the signals are necessary to be quantized before they 
are sent to the network. After the data are transmitted through network, the 
method of data fusion can be used to fuse the data to reduce the burden of 
respondents and avoid bias, then predictive control is adopted to deal with 
data losses and asynchronous measurement sampling in the control system, 
the last and necessary step is fault detection, which is used to detect fault 
and make a binary decision-cither that something has gone wrong or that ev- 
erything is fine. Therefore, quantization, data fusion, predictive control and 
fault detection are the main four issues in NCSs. 



1.5.1 Quantization over Networks 

Control using quantized feedback has been an important research area for a 
long time. A quantizer is a function that maps a real-valued function into a 
piecewise constant function taking on a finite set of values. At present, there 
exist two kinds of quantizers, which are uniform quantizers and logarithmic 
ones. As for uniform quantizer, which maps real-valued function to a finite 
number of quantization regions with rectilinear shape (|17j) or arbitrary shape 
([100]). The study of system affected by uniform quantizer is always basing 
on "zoom" strategy , which is usually composed of two stages, i.e. "zooming- 
out" and "zooming-in" . In first stage, the range of quantizer is increased 
to guarantee the states of system can be adequately measured. In second 
stage, the quantization error is decreased to drive the states to the origin. 
When system is affected by logarithmic quantizer, in which the quantization 
levels are linear in logarithmic scale, the simple classical approach to analysis 
and mitigation of quantization effects is to treat the quantization error as 
uncertainty or nonlinearity and bound it using a sector bound (|51j). The 
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main problem about quantization is to find a quantized feedback control law 
to stabilize the given system which can be stabilized by linear time- invariant 
feedback. 

There is a new line of research on quantized feedback control where a 
quantizer is regarded as an information coder. The fundamental question of 
interest is how much information needs to be communicated by the quantizer 
in order to achieve a certain control objective. The problem of quadratic sta- 
bilization of discrete linear systems using quantized feedback is studied in 
[40] . It is proved that for a quadratically stabilizable system, the quantizer 
needs to be logarithmic, which means that the quantization levels are linear 
in logarithmic scale. Furthermore, the coarsest quantization density is given 
explicitly in terms of the system's unstable poles. Note that the required 
quantizer has an infinite number of quantization levels because of its time- 
invariance nature. When a finite number of quantization levels are available, 
the so-called practical stability is obtained where there is a region of attrac- 
tion in the state and the steady state converges to a small limit cycle. In a 
different point of view ([IT]), the number of quantized values is treated as be- 
ing fixed a priori, but it allows to alter other quantization parameters while 
the system evolves. This approach enables to achieve asymptotic stability, 
which is a property that cannot be obtained with the schemes previously 
investigated. When the quantizer is allowed to be dynamic and time-varying, 
it is obviously advantageous to scale the quantization levels dynamically so 
that the region of attraction is increased and the steady state limit cycle is 
reduced. In addition, the minimum number of quantization levels is explicitly 
related to the unstable poles of the system under the assumption of noise free 
communications. In this setting, the dynamic quantizer effectively consists of 
two parts: an encoder at the output end and a decoder at the input end. 

We do caution that many results on quantized feedback with dynamic 
quantizers may be impractical due to three problems: 1) Most results are for 
stabilization only rather than for performance control; 2) The transient re- 
sponse is typically very poor due to the lack of good control design algorithms; 
3) The capacity results are in general not valid for practical communications 
channels which are not noise free. The section of quantization in this book 
attempts to solve these problems. 



1.5.2 Data Fusion over Networks 

Initial data fusion applications are predominant in the defense systems. Data 
fusion originates from market studies especially in media and consumption 
surveys, where it is often impossible to ask the same sample all the items 
when there are too many questions. There is an increasing interest in data 
fusion due to the availability of multiple sources in various fields. In order 
to reduce the burden of respondents and thus avoid bias, one proceeds with 
two different independent samples where the questions of interest are split 
two parts with a common set of descriptors. Numerous mathematical tools, 
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such as probability theory, Bayes analysis, evidence theory, possibility the- 
ory, fuzzy-logic, neural networks and evolutionary algorithms, are applied 
in solving data fusion problems. Currently, this field has expanded to cover 
many research topics in which data fusion is an essential component: combin- 
ing and updating the mapping of gravitational anomalies and meteorological 
variables, target tracking, land mine detection, threat assessment, to name a 
few. Medicine, geoscience and industrial engineering are some other research 
fields which have vast applications of data fusion. With the rapid group of the 
internet and other electronic sources of information, the problem of the coher- 
ent merging of information from multiple sources has become an important 
issue. Unified fusion rules are proposed in the sense of best linear unbiased 
estimate and weighted least-square for all fusion architectures ([96 ). A state 
estimation fusion algorithm which is optimal in the sense of maximum a pos- 
teriori is proposed in [24] . An algorithm accounting is provided in [19] for 
dynamically changing interconnections among sensors, unreliable communi- 
cation links, and faults, where convergence of the estimates to the true values 
is proved, under suitable hypothesis of "dynamical" graph connectivity, while 
in |172j the authors propose a minimum variance estimator for distributed 
tracking of a noisy time-varying signal. The problem of distributed discrete- 



time state estimation over sensor networks has been considered in [165] . 

Some terms of the estimation fusion problem are defined in [168 . The term 
"raw measurement" refers to the measurement from any sensor at the end of 
its signal processing chain. The term "processed measurement" refers to the 
data after some transform of the raw measurement to be used for estimation. 
One of the purposes in processing the raw measurements is to compress the 
data and save communication bandwidth. The term "local estimate" refers 
to any estimate that uses measurements from the local platform. A local esti- 
mate may include data from a single sensor or multiple sensors, but all inputs 
must be from the local platform or the data processing unit. The fusion sys- 
tems use three basic approaches of communication between a local platform 
and the fusion center, namely: i) sending raw measurements, ii) sending pro- 
cessed measurements, e.g., quantized measurements to satisfy the bandwidth 
constraint, iii) sending local posteriors, e.g., local estimates/covariances. The 
third approach is commonly used in the existing distributed tracking sys- 
tems. To design a fusion system, one needs to choose the system architec- 
ture, develop an algorithm to perform the fusion based on certain optimality 
criterion, and find a way to compute the possible cross-correlations among 
the estimation errors from different sources. Apart from these three steps, an- 
other major component is to develop a data association algorithm when there 
is an association ambiguity among the local estimates from different sources. 
[9] presents an algorithm for the association of multiple estimates in target 
tracking. For brevity data association from different sources for estimation 
fusion will not be discussed further. 
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1.5.3 Predictive Control over Networks 

In model predictive control, the current control action is obtained by solving 
a finite horizon open-loop optimal control problem on-line using the current 
state of the plant as the initial state at each sampling instant. The optimiza- 
tion yields an optimal control sequence, in which the first control is applied to 
the plant. This is its main difference from conventional control which uses a 
pre-computed control law. It can be seen that the raison d'etre for model pre- 
dictive control with the clarity gained by hindsight is able to handle control 
problems, where off-line computation of a control law is difficult or impossible 
although other features, such as its capability for controlling multi-variable 
plants, are initially deemed more important. Almost all applications impose 
constraints, for example, actuators are naturally limited in the force, safety 
limits states such as temperature, pressure, velocity and efficiency. 

In the present work, the model-based control approach is adopted to deal 
with data losses and asynchronous measurement sampling in the control sys- 
tem. A Lyapunov-based model predictive controller is proposed for a broad 
class of nonlinear uncertain systems with both disturbances and data losses. 
Model predictive control is a popular control strategy based on a model to 
predict in the process of control at each sampling time, the future evolution 
of the system from the current state follows a given prediction horizon. Using 
these predictions, the input trajectory that minimizes a given performance 
index is computed by solving a suitable optimization problem. To solve fi- 
nite dimensional optimization problems, MPC is used to optimize a family 
of piecewise constant trajectories with a fixed sampling time and a fixed pre- 
diction horizon. Once the optimal problem is solved, only the first input is 
implemented, the rest of the trajectory is discarded and the optimization 
is repeated at the next sampling step. In |136) . MPC framework is particu- 
larly appropriate for controlling systems subject to data losses because the 
actuator can profit from the predicted evolution of the system. In recent 
years, a wide class of MPC algorithms have been documented many times, 
for examples [Ml 1751 Tl58j . and the references therein. Furthermore, a sub- 
optimal model predictive control algorithm is proposed to reduce the severe 
computational problems [159j . By using a parameter dependent Lyapunov 
functional, a MPC law for linear parameter varying systems is proposed in 
|187j . For nonlinear system, a robust MPC algorithm is developed by using 
a contractive formulation |157j . Moreover, a MPC algorithm is presented for 
nonlinear sampled data control systems |115j . Another MPC of nonlinear 
systems subject to data losses is considered in [35]. A MPC for constrained 



linear systems to track piecewise constant references is presented in [102 . 
A solution to a finite-horizon MPC problem for max-plus-linear systems is 
derived in |128j . The problem of robust MPC satisfying hard constraints on 
inputs and outputs of a closed-loop system with polytopic type uncertain- 
ties is investigated in [204J. Other researches about MPC can be shown as 

usa esi una una una m ■ 
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1.5-4 Fault Detection over Networks 

Observer based fault detection and isolation technology has attracted much 
attention from many researchers because of the increasing demand for re- 
liability and safety in industrial processes. Generally speaking, an observer 
based fault detection system consists of an observer based residual generator 
and a residual evaluator. The basic idea of fault detection is to construct a 
residual signal and compare it with a predefined threshold. If the residual ex- 
ceeds the threshold, an alarm is generated. Because noises and disturbances 
may result in significant changes in the residual and lead to false alarms, 
fault detection observers have to be robust, namely, it is insensitive or even 
invariant to noise and disturbances. A residual generator for fault detection 
based on multirate sampled data is designed in [87] . Moreover, some results 
on fault detection and isolation by using frequency domain approach have 
been reported in literature, such as [15CT1 I228] . Problems related to the inte- 
grated design of robust fault detection systems in time-frequency domain are 
studied in [215] . 

Usually, Hoc norm optimization technique is used to design the robust fault 
detection observers, the way of this technique is to introduce a performance 
index and formulate the fault detection as an optimization problem. But the 
technique may result in significant changes in the residual and lead to false 
alarms, and it is contrary to main objective of fault detection because the 
i?_ norm measures the maximum effect of an input on an output. Based on 
H- , which is defined as the smallest nonzero singular value of the transfer 
function matrix from fault to residual at the particular frequency, the study 
on minimum singular value aiming to maximize the minimum effect of faults 
on the residual output of a fault detection observer has gained much attention. 
On the one hand, the linear matrix inequality methodology has been under 
intensive research and widely used for various kinds of robust control and 
filtering problems. One advantage of the LMI approach is the relative ease in 
incorporating additional design objectives into the formulation. Hence, LMI 
formulations for the H- and mixed H_/ Hoo problems are of interest. Based 
on these performance evaluation criteria, multiple objective optimal filter 
problems such as H^/H^ have attracted a great deal of research interests 
in the recent years, for examples [H7J (TSJ HE] • There are also some results on 
fault finite frequency ranges detection filters with Hoc and H- performance 
indices for discrete systems [190] and continuous systems [191j . respectively. 
In view of the wide usage of network cables in today's world, a seemingly 
natural research problem is to study fault detection problems for networked 
systems in the presence of network-induced delays or/with data missing |138j . 



1.6 Summary 

As there are more and more applications of NCSs in industry, such as traffic, 
communication, aviation and spaceflight, more attention in this area has been 
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paid to design and analysis of NCSs. The main problems about NCSs are 
quantization, data fusion, predictive control and fault detection. In this book, 
these four issues are discussed on NCSs affected by network-induced delay, 
packet dropout, which are the significant factors in NCSs. The results in this 
book will no doubt advance the study of NCSs and potential applications in 
the area of Internet of Things. 



Part I 
Quantization over Networks 



Chapter 2 

Stability Analysis of Quantized 

Systems over Networks 



2.1 Introduction 

Recently there have been many of interests in NCSs, that is, control systems 
closed via possibly shared communication links with delay/bandwidth con- 
straints. Particularly, Internet based control systems allow remote monitoring 
and adjustment of plants over the Internet. This enables the control system 
to benefit from the way it retrieves data and reacts to plant fluctuations 
from anywhere around the world at any time, see for example [56j EH], and 
references therein. The main advantages of NCSs are low cost, simple instal- 
lation and maintenance, and potentially high reliability. As the structure of 
NCSs is different from that of traditional control systems, there exist various 
specific problems in NCSs, for example, quantization, network delay, loss of 
data packets, network security and safety |148j . In recent years, more and 



more network techniques have been applied to control systems |133j . much 
attention has been paid to the study of control design and stability analysis 
of NCSs ( pgingll 12251 I22TI [TO1 [122]). A state estimation problem involving 
bit-rate communication capacity constraints is studied in |119j . A current 
survey of the emerging field of NCSs is provided in [7] and Hespanha, et. al 
review several recent results on estimation, analysis, and controller synthe- 
sis for NCSs in [70]. In |206j . a practical architecture and some algorithms 
for the networked data fusion system with packet losses and variable delays 
are given, in which optimal state estimates through network are presented. 
However, one important issue is not considered in [206) . that is, the measure- 
ment or estimated states have to be quantized before they are sent through 
network. 

Many research results on quantization have been obtained. For example, 
the problem of detectability and stabilization of nonlinear systems via lim- 
ited capacity digital communication channels is considered in [152J, state es- 
timation and stabilization with coder-decoder and coder-decoder-controller 



procedures are studied in [238 and the controllability condition under the 
discrete- valued input in |144) . The characterizations of the minimum data 
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rate and the quantization level for stabilizing feedback control systems are 
considered in [301 11251 1178] , and the optimal quantizer for the identification 
and control is discussed in [TH]. An optimal dynamic quantizer is proposed 
for control of linear time-invariant plants whose inputs are constrained to be 
discrete- valued in [Hj . In [T7] , Brockett and Liberzon consider the problems of 
quantized feedback stabilization of linear system and propose a new control 
design methodology which yields globally asymptotic stability of the systems. 
|100j and |101| conduct a deeper study based on [T7] . Although fruitful results 
on quantization can be found in recent publications, there are still a lot of 
space for further investigation such as quantization problems under network 
conditions. 

In fact, there are some works about quantized systems over network. For 
example, the problem of output feedback control for NCSs with limited com- 
munication capacity is considered by Engang Tian, Dong Yue, Chen Peng 



in |181| . Very recently, [137j . [182j and |223j propose some new results about 
the guaranteed cost control and Hoo control of continuous systems over net- 
work with quantization, where the effect of both network conditions and 
data quantization are taken into consideration. Yue et al. 223J considers the 
guaranteed cost control of continuous systems over networks with state and 
input quantization based on the sector bound condition of quantizer given 
in [5T]. Gao et al. [5S] combines the transformation method similar to 223 
with a technique of two successive delay components, and investigates prob- 
lems of Hryo stability and stabilization for continuous-time NCSs with only 
quantized state feedback. The problems of -ffoo stability and stabilization for 
NCSs with both sensor-to-controller and controller-to-actuator quantizations 
are considered in [239 . The issue of designing quantizers in order to reduce a 
remote control system, where the plant and the controller are connected by 
a network cable, to be stable has been studied in [5fJj . 

In this chapter, the problem of quantized feedback under network condi- 
tions is considered. It is known that the quantized feedback problem has been 
considered in [17] and globally asymptotic stability is achieved. This chapter 
has many different points from |17j . First, the network is considered in this 
chapter. Second, the stability discussed in this chapter is not the same as 
globally asymptotic stability. Third, Kalman filter is adopted in this chapter 
to estimate states from measurements on the sensor side. So, this chapter 
has its own significance. In this chapter, a simple quantization strategy is 
proposed and the feedback control is designed based on quantized estimated 
states sent through network. Sufficient condition is given to guarantee the sta- 
bility of the closed-loop systems. Finally, a numerical simulation is presented 
to show the effectiveness of the main results. 

This chapter is organized as follows: Section [2.21 gives the problem formu- 
lation. Quantization strategy is proposed in Section |2~B1 Section |2~31 presents 
the results of the stability of the closed-loop systems. A numerical example 
is designed in Section |2"31 Some conclusions are given in Section [ 
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2.2 State Estimation Based on Kalman Filter 

In this section, we will consider the following system: 



x(k + 1) = Ax(k) + Bu{k) + u>(k) 
y(k)=Cx(k)+v(k) 



(2.1) 



where x(k) £ R n is the state variable, u(k) € R p is the control variable, y{k) £ 
R m is the measurement output, A £ R nxn [ s the system matrix, B £ R nx P 
is the input matrix, C £ R mxn is the measurement matrix, to(k) £ R n is the 
input noise, v(k) £ R m is the measurement noise. The following assumptions 
are standard. 

Assumption 2.1. A is unstable and (A, B) is controllable. 

Assumption 2.2. ui(k) £ R n and v(k) £ R m are the uncorrelated white 
noises with zero mean and 

E[u(k)w T (j)} = QS kj 

E[v{k)v T (l)\ = R5 kl (2.2) 

E[uj(k)v T (j)} = 

Assumption 2.3. The initial state x(0) is independent ofuj(k) and v(k), k = 
1,2, ---M and 

E[x(0)} - Ai 
E[(x(0) - fi o )(x(0) - fi ) r ] = Po 



Ti __ P (2-3) 



The following lemmas will be used to prove our main results in this chapter. 

Lemma 2.1. ffltf Assume A £ R nxn , p(A) denotes spectral radius of matrix 
A. Then for any e > 0, there exists a kind of norm \\ ■ \\m satisfying: 

\\A\\ M < p{A) + e (2.4) 

Lemma 2.2. I49tj The norms are equal to each other in finite norraed linear 
space, that is, for any two kinds of norm || • ||i and || • \\2, there exist positive 
constants C\ , C2 , C3 and C4 satisfying: 

ci|| • Hi < || • || 2 < call • ||i (2.5) 

call • ||a < II • 111 < C4|| • || 2 (2.6) 

Some notations are defined as follows: 

Y(k) = [y(l) r --,y(k)} T 

x(k\k) = E[x(k)\Y(k)} 

P(k\k) = E[(x(k) - x(k\k))(x(k) - x(k\k)) T \Y(k)} (2.7) 

x{k + l\k) =E[x(k + l)\Y(k)] 
P(k + ljjfe) = E[(x(k + 1) - x(k + l\k)) T \Y(k)} 



18 



2 Stability Analysis of Quantized Systems over Networks 



The purpose of this chapter is to propose a quantization strategy and design a 
quantized feedback controller u(k) which depends on estimated value x(k\k) 
basing on Kalman filtering f [206p such that system (|2.ip is stable. 
The Kalman filter based state observer is designed as 



x(k\k - 1) = Ax{k - 1|& - 1) + Bu(k - 1) 

x{k\k) = x_(k\k - 1) + K_{k){y{k) ~ Cx(k\k - 1)) 
P(k\k) = P_(k\k - 1) - K{k)CP{k\k - 1) 
K{k) = P(k\k - l)C T (CP(k\k - l)C T + R)- 1 



(2.8) 



where x(k + l\k) £ R n and u(k — 1) G R m are the one-step ahead state 
prediction and the input of the observer at time k, P(k\k — 1) is the solution 
of the following Riccati equation [167] 

P(k\k - 1) = AP(k - l\k - 2)A T +Q-P(k- l\k - 2)C T 

(CP(k - l|fc - 2)C T + RY 1 CP{k - l\k - 2)A T (2.9) 

Due to the insertion of network, the estimated states have to be quantized 
before being sent through network, the control strategy proposed in this 
chapter is shown as Fig. 12.11 
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u(k) 
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u(k-l) 
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filter 



D°Q&k\k)) 



Decoder 
DO 




x(k 



Quantizer ^ 

QO 



k) 



Fig. 2.1 Control based on quantized states. 



It is assumed that the input of the plant at last time can be used as an 
input of Kalman filter, which is reasonable in some cases. The estimated states 
x(k\k) are quantized before sent through network, as is shown in Fig. 12.11 the 
quantizer Q(-) is introduced to quantize x(k\k). At the other side of the 
network, Q(x(k\k)) is decoded by decoder D(-) such that the closed-loop 
system ()2.1|) is stable with quantized feedback. 



2.3 Quantization Strategy 
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2.3 Quantization Strategy 

Let us consider the quantizer Q(-). First, the 2-dimcnsional state quantization 
is considered to show the method proposed in this chapter, and then we 
extend it to the n-dimensional case. As is shown in Fig. 12.21 the quantization 
regions are squares with length L and the quantized value is a sequence. 



{ 



(-1,1) 



-{-1--C-)- 



(-1,-1) 



(0|1) (1,1) 



(4;0> (i-,-0)- 



(0,hl) (1,-1) 



Fig. 2.2 2-dimensional state quantization. 



If x — [xi x 2 ] T with x\ e (—L/2,L/2) and x 2 G (—L/2,L/2), then x 
will be quantized to (0, 0) by quantizer Q(-), that is, Q(x) — (0, 0). In other 
words, as to x = [x\ X2} 7 ', we will ensure the components sequence according 
to the interval which components belong to. Indicated by Fig. 12.21 we can see 
that the quantization rule of quantizer Q : R 2 — > Z x Z is: 



Q([x 1 x 2 f) = (i,j) 



(2.10) 



where Z denotes integer set, x\ e (iL — L/2,iL + L/2), x 2 € (jL — L/2,jL + 
L/2). 

Decoder D(-) : Z x Z — > R 2 decodes the sequence (i,j) to the center of 
the square, that is 

D((i,j)) = [iLjL] T (2.11) 

where i, j G Z. 
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As to the vector x on the edge of square, we quantize it according to 
the principle of the smallest vector norm after decoding the quantization 
sequence. For example, we choose (0, 0) as the quantized value of the * point 
on the edge of square. That is obtained according to the principle of the 
smallest vector norm after decoding the quantization sequence. After decoded 
by decoder £)(•), (0, 0) is transferred to [0, 0] T and (-1, 0) is to [-L 0] T . It is 
obvious that vector norm after decoding is smaller by selecting (0,0), which 
is shown in Fig. 12.31 



{ 



(-1,1) 



-i-i&y 



\ 



(-i,-i) 



(0. 



i) 



-Q&- 



(0J 



1) 



(1,1) 



-(■■ho}- 



(1,-1) 



Fig. 2.3 Indication for edge point's quantization. 



According to the quantization rule, it can be shown that the components 
of vectors on the edge of squares can be quantized to —iL/2 or iL/2, where 
i is a positive odd number. The sequence numbers of —iL/2 and iL/2 are 
ensured by the following rule: 



-iL/2-> -(i- l)/2 
iL/2 -»■(»- l)/2 



(2.12) 



where i is a positive odd number. 

As to n-dimensional vector, 2-dimensional square in Fig. 12.21 is changed 
to n-dimensional super square box without an intuitive geometric figure to 
represent it. 
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The quantization rule of n-dimensional quantizer Q : R n — ► Z n is obtained 
easily by extending the 2-dimensional case: 

Q([xi x 2 ■■ -X n ] T ) = (ii, i 2 ,- --in) (2-13) 

where, Z denotes integer set, Xk G (ikL — L/2, i k L + L/2), k = 1, 2, • • ■ n. 
The decode rule of decoder D : Z n — > i?" is: 

^((«l,*2,---tn)) = [*l^*2^ ■■■inLf (2.14) 

where ii,Z2, ■ ■ ■ ,i n G Z. 

The quantized value of the point on the edge of the n-dimensional super 
square box is ensured by rule (12.121) . 

Then, we can obtain a general equation for quantization from the previous 
analysis: 



^ = rt - §i x k > o 

*fc = Lx + IJ ^ < ° 



? ?^n (2-15) 



where, x/c is the kth component of the n-dimensional vector and i k is the 
quantized value of Xk, [•] and [ - J indicate the integer function upward and 
downward, respectively, which can be described as follows: 

\x] — m + 1 m < x < m + 1 , , 

[a;J = m m < x < m + 1 

where m G Z . 

From Assumption 12.11 it follows that there exit a positive definite matrix 
P and matrix K satisfying the following equation: 

(A + BK) T P{A + BK)-P = -I (2.17) 

It is obvious that A+BK is a Schur stable matrix based on Lyapunov stability 
theory and (|2~TT|) . We design u(k) = KD o Q(x(k\k)), system ([2~H can be 
written as 

x(k + 1) = Ax(fc) + BKD o Q(&(fc|fc)) + w(k) (2.18) 

Then the following equation is obtained from (|2.18p 

x(k + 1) = Ax(k) + BKE[D o Q(£(fc|fc))] (2.19) 

Definition 2.3. Let x(k) ---- E[x(k)} and P(k) = £[(a:(fe) - x(fc))(a;(fc) - 

lim : 

fc — >oc 

constant M > such that ||P(fc)|| 2 < M. 



a;(fc)) T ], system (|2.1|) is said to be stable, if lim x(k) = and there is a 
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2.4 Stability Analysis 

In this section, a quantization control strategy is given based on quantization 
strategy presented in previous section and the stability of system is discussed. 
System (12.18)) can be written as: 

x(k + 1) = Ax{k) + BKD o Q(x(k\k)) + u{k) 

= (A + BK)x{k) - BK(x(k) - x(k\k)) - BK((x{k\k) . , 

-DoQ(x(k\k)))+uj(k) [ Uj 

= (A + BK)x{k) - BK(x{k) - x(k\k)) - BKs(k) + uj(k) 

where s(k) = x(k\k) — Do Q{x(k\k)). 

Since the estimate x(k\k) is unbiased, take the expectation at both sides 
of (I2.20|) . the following equation is achieved: 

x(k + 1) = (A + BK)x - BKE[s{k)\ (2.21) 

In fact, equation (|2.21[) is equal to (|2.19p . 

The inequality ||s(fc)||2 < ^/nL/2 can be obtained by the former quanti- 
zation strategy. Let s(k) = E[s(k)], the following inequality can be derived 
according to the above inequality: 

||s(fc)|| 2 = ||£;[a(fc)]|| 2 < E[\\s(k)\\ 2 } < V^iL/2 (2.22) 

In the sequel, a quantization control strategy depending on Lyapunov sta- 
bility theory is presented. Lyapunov function can be chosen as V(x(k)) = 
x T (k)Px(k)(P > 0) by quantization rule (|2.15p and equation (|2.17p . Let 
A and A indicate the maximum and minimum eigenvalue of the symmetric 
positive definite matrix P, then A > and A > 0. 
Let AV(x(k)) = V(x(k + 1)) - V(x(k)), then 

AV(x(k)) = x T (k)(A + BK) T P{A + BK)x(k) - x T (k)Px(k) 

-2x T (k)(A + BK) T PBKE[s{k)\ + E T [s{k)]K T B T BKE[s{k)] 
= -||x(fc)||! - 2x T (k)(A + BK) T PBKs{k) 
+s T (k)K T B T BKs(k) 

<-\\x(km+2\\(A + BK) T PBK\\ 2 \\x(k)\\ 2 \\- S (k)h 
+\\BK\\l\\S(k)U 

<-(i-e)\\x(k)\\l-(e\\x(k)\\l 



M\(A + BK) T PBK\\ 2 L\\x(k)\\ 2 -nL 2 \\BK\\l/A) 

2 
2 



<-(i-e)\\m\ i2 



(2.23) 



when 



s(fc)|| 2 > (V^L/29)Q\(A+ BK) T PBK\\ 2 



j (A + bkypbkwi + e\\BK\\D,e € (0, 1) 
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For simplicity, let 



n = {\\{A + BK) 1 PBK\\ 2 + yJ\\(A + BK) T PBK\\l + 9\\BK\\ 2 2 ) (2.24) 

then AV(x{k))<-{l-9)\\x{k)\\l can be guaranteed by ([2T23]) when ||z(fc)||2 > 
{^/nL/29)n. 
Let 

i? = {S(fc) <= i?" : ||S(fc)|| 2 < (y/nL/2d)II} (2.25) 

From the above discussion, it can be concluded that if there is a time i 
such that ||x(fc)(t)||2 > (y/nL/2d)LT, there exists a finite time T such that 
x(k) £ i?o when k > T, that is, the track of x(k) is in i?o after T. Observing 
the variability of parameter L, if L is decreased, a new smaller sphere can 
be defined similar to (|2.25[) to make x(k) arrive at it in finite time and never 
leave it thereafter. In the ideal case, when L is reduced infinitely small, the 
sphere reduces infinitely small correspondingly. From (|2.23[) , it can be shown 
that J?o — > when L — > 0, that is, x(k) — > when k — ► oo. 

Let a constant £ 6 (0, 1) represent the decay factor of L, that is, take 
Li = QL to represent the length of super square box after the «th decay, 
where i = 0, 1, • • •. The spheroid is defined as: 

fl % = {x(k) e iT : ||S(fc)|| 2 < {^iL t /26)II} (2.26) 

Let r, be the time when S(fc) enters the spheroid f2i and decreases L for the 
ith time. Define Tj+i as the time when x(fc) enters the spheroid i?i+i. Let 
AT(i,i + 1) = Tj+i — Tj, then a time interval is defined by AT. Generally 
speaking, it is difficult to get the time interval precisely, but the upper bound 
which is enough in practice can be obtained. 

Assume x(k) £ fli, x(k) $_ £2i+i and L is decreased (i+l)th at time instant 
k. From (12.23[) . it can be shown that 

V(x(k + I)) - V(x(k)) < -(1 - 6)\\x{k)\\l < -(1 - 6)V(x(k))/X (2.27) 

Then 

V(x(k + 1)) < (1 - (1 - 6)/X)V(x(k)) (2.28) 

Suppose that (1 - (1 - 6)/\) < 1 or (1 - (1 - 6)/\) < 0. In the later situation, 
it follows that x(-) is able to reach zero at time instant k + 1 according to 
(|2.28p . But an upper bound is needed, thus, a general case is assumed, that 
is, < (1 - (1 - 6)/X) < 1. From (|2~2^|) . it results in 

V(x(k+ P )) <(!-(!- 6)/X) p V(x(k)) (2.29) 
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And then 



\\x(k+ P )h < v / (l-(l-9)/X)PV(x (k))/X 

< y\(i-(i-9)/wil \\mh ( 2 -3o) 

< VW - (i - 0)/x) p /A(V^Lj29)n 

In order to get the upper bound of time interval, let the last line of (|2.30p be 
smaller than the radius of sphere J2j+i, then 



yj\(l - (1 - 0)/\)P/\(CVnL/2d)II < (VnL i+1 /20)II (2.31) 

Let a = 1 - (1 - 9)/X, then 

P < log a (AC 2 /A) (2.32) 

and then, 

AT '(*,» + 1) <lo go (AC 2 A) (2-33) 

It is obvious that the right side of inequality (|2.33p is a constant. Let AT(i, i + 
1) = AT, it results in 

AT < log a (AC 2 /A) (2.34) 

Then an upper bound of time interval between reduced time and arrival time 
is obtained. 

Let e(k) — x(k) — x(k\k) and P(k) — E[e(k)e T (k)}, then there exists 
a positive definite matrix M > such that .E[||e(fc)||2] < M. Considering 
s(k) = s(k) — s(k) and above discussion, the following inequality can be 
obtained: 

||*(*)||2 < ||a(fc)|| 2 + ||*(fc)|| 2 < y/nLi - ^ (2.35) 

Then 

E[\\m\\l] < Si (2.36) 

Let e(k) = x(k) - x(k), it follows from ([2~2l]|) and ([2T2T|) that 

e(k + 1) = (A + BK)e{k) - BKe(k) - BK~s{k) + w(k) (2.37) 

Then 

P(k + 1) = E[e(k + l)e T (k + 1)] 

= {A + BK)E[e(k)e T (k)](A + BK) T 
~{A + BK)E[e(k)e T (k)]K T B T 

-(A + BK)E[e(k)s T (k)]K T B T - BKE[e(k)e T (k)](A + BK) T 
+BKE[e(k)e T (k)]K T B T + BKE[i(k)S T (k)]K T B T 
-BKE[s{k)e T {k)]{A + BK) T + BKE[s(k)e T (k)]K T B T 
+BKE[S(k)S T (k)]K T B T + Q 

(2.38) 
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From the above discussion, the following inequality can be obtained: 

P(k + 1) < 2(A + BK)P(k)(A + BK) T -{A + BK)P{k)K T B T 
-BKP(k)(A + BK) T + 2BKE[s{k)s T {k)\K T B T 
+BKP(k)K T B T + BKE[e(k)S T (k)]K T B T 
+BKE[s{k)i T {k)]K T B T + Q 
= 2(A + BK)P(k)(A + BKf + AP(k)A T 

-(A + BK)P(k)(A + BK) T + 2BKE[s{k)s T {k)]K T B T 
+BKE[e{k)~s T {k)]K T B T + BKE[s(k)i T {k)]K T B T + Q 

(2.39) 
where AA T + BB T > —AB T — A T B and the following equality are useful 



E[e{k)e T (k)} = E[(x(k) - x(k))e T (k)} 

= E[(x(k) - x(k\k) + x(k\k) - x{k))e T {k)] 
= P{k) + E[x(k\k)e T {k)} - x{k)E[i T {k)\ 
= P(k) 



(2.40) 



Let Li be the length of super square box, the boundedness of P(k) can 
be guaranteed by Lemma 12.21 For the norm discussed in Lemma 12.21 it is 
assumed that there exist constants c > and c > satisfying c\\ ■ 1 1 2 < 
II ■ ||m < c ll • lb, where || • H2 denotes 2 norm in Euclid space. 

Basing on above analysis and observing that A, A + BK, P(k), P(k), BK, 
s(k)s T (k), e(k)s T (k) are all square matrices, we have 

||P(fc + 1)||m < 2\\A + B^|| 2 M ||P(fe)||M + \\A\\ 2 M \\P(k)\\ M 

+ \\A + BK\\l 4 \\P(k)\\ M + 2\\BK\\UE[mS T (k)}\\M 
+ \\BK\\l I \\E[e(k)s T (k))\\ M + \\BKf M \\E[s(k)e T (k)]\\M 
+ \\Q\\m 

<2\\A + BK\\l 4 \\P(k)\\ M + c 3\\A\\t\\P(k)\\ 2 

+c 3 \\A + BK\\l\\P(k)\\ 2 + 2c 3 \\BK\\ 2 2 \\E[S(ky S T (k))h 
+c^\\BK\\l\\E[m~s T mh + cnBK\\l\\E[s(k)e T {k)]h 

+4Qh 

<2\\A + S^|| 2 M ||P(fe)|| M + c 3 P|||||P(fc)|| 2 

+c 3 \\A + BK\\l\\P(k)\\ 2 + 2c 3 \\BK\\lE[\\S(k)\\l] 

+2c 3 \\BK\\ 2 E[\\i(k)\\ 2 \\s(k)h}+4Qh 
<2\\A + BK\\l I \\P(k)\\ M + c 3 \\A\\l\\P(k)\\ 2 

+c 3 \\A + BK\\ 2 \\P(k)\\ 2 + 2c 3 ||i3^|||P[||S(fc)||I] 
+2c 3 \\BK\\l{E[\\m\\l}}HE[\\m\\l\^+4Q\\ 2 
<2\\A + BK\\l I \\P(k)\\ M + c 3 (\\A\\l + \\A + BK\\l)M 

+2c 3 \\BK\\ 2 S l + 2c 3 \\BK\\ 2 2 VMVS~ i + c\\Q\\ 2 
<2\\A + BK\\ 2 M \\P(k)\\ M + c 3 {\\A\\l + \\A + BK\\l)M 

+2c 3 \\BK\\lS + 2c 3 \\BK\\lyfMy/S^ + c\\Q\\ 2 

(2.41) 



2<i 
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Let 



\A\\l + \\A + BK\\l)M + 2\\BK\\lS + 2\\BK\\lVMy/^[+c\\Qh, 



it is obvious that S > 0, then (I2.41[) can be written as 



\P(k + l)\\ M <2\\A + BK\\ 2 M \\P(k)\\ 



M i- ■= 



(2.42) 



Theorem 2.4. // p(A + Bif) < \/2/2, i/iere exists a kind of quantization 
control strategy such that system \2.1\) is stable in the sense of Definition[ 



Proof. The quantization control strategy which make lim x{k) — is dis- 

k — >oo 

cussed above. In the following part, inequality (|2.42[) is used to prove that 
there exists a constant M > such that ||P(fc)||2 < M. 
A sequence is defined as 



m(k + 1) = 2\\A+ BK\\ 2 M m{k) + 5, m(0) = ||P(0)|| M 



(2.43) 



It is obvious that \\P(k)\\ M < m(k). From Lemma[2TT1and p(A+BK) < \/2/2, 
\\-\\ M satisfying ||A+Bif|| M < V^/2, then 2||A+Pi^||^ f < 1 can be obtained. 
For any finite initial value which is larger than zero, the sequence {m(fe)}^_ 1 
is convergent to a positive constant 5/(1 — 2\\A + BK\ 



\ 2 M ), that is, 



lim m(k) = 5/(l-2\\A + BK\\ 2 M ) 

k— >oc 



(2.44) 



Because of the boundcdness of convergence sequence, it can be seen that 
there exists a constant M > such that < m(k) < M, then ||P(fc)||M < M 
and ||P(fc)|| 2 < M/c. 

Therefore, system (|2.1I) is stable in the sense of Definition [531 based on the 
quantization control strategy proposed above. 

Remark 2.5. Because of the controllable of (A, B), the poles of A + BK 
can be assigned arbitrarily, therefore, the condition p(A + BK) < \p2/2 in 
Theorem 12.41 can be satisfied. 



2.5 Numerical Example 



Simulation is given in this section to demonstrate the performance of the 
quantization strategy designed above comparing with the conventional state 
feedback control u = Kx. The model is taken from [81], which is specified by 

, B = „ „ ,C=[ll], w(k) and v(k) are white noises with 



A 



1.3 0.3 

1.2 



covariance matrices Q 



1 

0.5 


,C=[1 




"0.01 




0.01 



and R — 0.01. The feedback gain is 



selected as K = [ —5.28 6.16] which satisfies the condition in Theorem 12.41 
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The system performances under the two control strategies are depicted 
in Fig. 12.41 -Fig. 12.121 when L — 0.01. It is apparent that the system behav- 
ior under the quantization scheme is almost the same as conventional state 
feedback control approach (see Fig. 12.101 and Fig. 12. lip , and the norm of 
estimated error covariance is finite (see Fig. I2.12p . 




Fig. 2.4 Estimated state X\ when L=0.01. 




90 100 



Fig. 2.5 Estimated state X2 when L=0.01. 



The system states are depicted in Fig. l2.13T Fig. l2.14l when parameter L is 
selected as L — 1. It is clear that the system performance under the quantiza- 
tion scheme is inferior than the state feedback control method. The norm of 
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Fig. 2.7 Quantized value of estimated state X2 when L=0.01. 



estimated error covariance is given in Fig. 12.151 which shows the boundness 
of the norm of estimated error covariance. 

The system trajectories are depicted in Fig. 12. 161 -Fig. 12.171 when parameter 
L is select as L = 1000. It is obvious that the system performance under 
the quantization scheme works badly. However, we can still guarantee the 
finiteness of the norm for the estimated error covariance although it is very 
large (see Fig. 12.181) . 

In the above simulations, it is clear that L is an essential factor in the per- 
formance of the closed-loop systems. When L is very small, such as L — 0.01, 
the performance of the closed-loop system with quantized feedback control 
is almost the same as the one with conventional feedback control (see Fig. 
12.101 and Fig. 12.11]) . When L = 1, the norm of covariance of estimated error, 
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Fig. 2.8 Decoded value of estimated state x\ when L=0.01. 
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Fig. 2.9 Decoded value of estimated state X2 when L=0.01. 



P(k), increases (see Fig. I2.15|) . While L — 1000, the norm of covariance of 
estimated error, P(k), increases remarkably (see Fig. 12.18]) . It is worth to say 
that even if L is very large, for example L = 1000, the states of system are 
bounded although the bound is very large. This is reasonable, because if L is 
small, in this example, L = 0.01, the error induced by quantization is small, 
and it is helpful to decrease the bound of estimated state x(k\k) after quan- 
tizing. If L increases, however, the decoder performs is not so well. In fact, 
when L > 1, the bound of quantized estimated state x(k\k) becomes larger 
after quantizing, which brings the negative effect to the system. Therefore, it 
is very important to choose a suitable L for implementation in practice. 
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Fig. 2.10 x\ with quantized control when L=0.01. 
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Fig. 2.11 X2 with quantized control when L=0.01. 
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Fig. 2.12 Norm of estimated error covariance when L=0.01. 
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Fig. 2.13 xi with quantized control when L=l. 
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Fig. 2.14 X2 with quantized control when L=l. 




Fig. 2.15 Norm of estimated error covariance when L=l. 
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; with quantized control 
; with conventional control 
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Fig. 2.16 xi with quantized control when L=1000. 
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Fig. 2.17 X2 with quantized control when L=1000. 
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Fig. 2.18 Norm of estimated error covariance when L=1000. 



2.6 Summary 



In this chapter, the stability of closed-loop systems based on quantization 
feedback has been investigated. The Kalman filter is employed in this chap- 
ter to estimate states from noisy measurements on the sensor side. A simple 
quantization strategy is proposed to quantize the estimated states. The feed- 
back control is designed based on quantized estimated states sent through 
network. Sufficient condition has been given to guarantee the stability of the 
closed-loop systems. 



Chapter 3 

Stabilization of Quantized Systems 

with Packet Dropout 



3.1 Introduction 

In recent years, NCSs have been actively investigated (; [229l[236ll22Tl[T6TlfT07l 
Una HZOl Hini HSni EH [S3 HOI HE! HI]). Due to the limited transmission 
capacity of the network and some devices in the closed-loop systems, data 
transmitted in practical NCSs should be quantized before they are sent to the 
next network node. Therefore, to achieve better performance of the considered 
systems, the effect of data quantization on the system should be taken into 
consideration. Furthermore, the network can be viewed as a web of unreliable 
transmission paths. Some packets not only suffer transmission delay but, even 
worse, can be lost during transmission. Thus, how such packet dropouts affect 
the performance of a NCS is an issue that must be studied. 

Nowadays, there are two quantizers used frequently, one is logarithmic 
quantizer and another is uniform quantizer. Comparing logarithmic quan- 
tizer with the uniform one, it is not hard to see that the former one holds 
more advanced performance around origin and the later one is more easily 
to operate. Each quantizer has advantages and disadvantages. Some of the 
recent works about logarithmic quantizer include [4"Ul[5Tl[8l)|,l5()lll)7j and some 
ones relating to uniform quantizer are [17) 100, 43, 46. 10HI50] . 

The purpose of this chapter is to consider the quantization issue and packet 
dropout issue simultaneously. Some papers have already studied the two prob- 
lems at the same time ( [1321 I5T1 1551 IT551 12221 ITB21 IT5T1 IT5T1 H551 1131 13551 I5T51 
0331123 EEI). The quantizers used in [I351IMIB5i rT551 12221 HB21 H371HSIIHBSJ 
are logarithmic ones. As to uniform quantizer, the problem of stabilizing lin- 
ear systems by taking quantization and packet dropout together is studied in 
[HI [2551 I2T21 IT351 [551 EH- Most of existing works considering quantization 
and packet dropout simultaneously do not study the effect of packet dropout 
rate on system performance. Reference [218 provid a sufficient and neces- 
sary condition to ensure the system to be asymptotically stabilizable in the 



mean square sense via quantized feedback. In |218| , the relationship between 
packet dropout rate and eigenvalues of system matrix plays an important 
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role. However, there is a strong assumption in [218] . that is, all the eigenval- 
ues of system matrix lie outside or on the unit circle. In fact, if the system is 
unstable, it can only ensure that there is at least one eigenvalue outside the 
unit circle. Furthermore, the quantization regions of uniform quantizer used 
in |218j hold rectangular shapes, which is not in general. 

In this chapter, we will consider the mean square stability of linear discrete 
system affected by uniform quantization and packet dropout simultaneously 
and show that the packet dropout rate is important to the performance of 
system. The shapes of quantization regions considered here are arbitrary and 
there is no limit to the eigenvalues of system matrix. The Lyapunov method 
and "zoom" strategy which involved in [T7] and |100| are used to guarantee 
the mean square stability of the discrete linear system. The "zoom" strategy 
is composed of two stages, i.e. "zooming-out" and "zooming-in" . In the first 
stage, the range of quantizer is increased to guarantee that the states of 
system can be adequately measured, at this stage, the system is open-loop. 
In the second stage, the quantization error is decreased to drive the states to 
the origin, at this stage, the system is closed-loop. Because the quantization 
regions in [T7] are rectilinear and the quantization regions with arbitrary 
shapes are considered in [100] , the uniform quantizer used in this chapter 
will adopt the one introduced in |100j . Although the "zoom" strategy used 
here is the same as [T7] and [100] , the analysis process is more complex than 
[T7] and [100] because of the consideration of packet dropout in this chapter. 

The contents of this chapter are as follows. In Section EP1 we introduce the 
quantizer used in this chapter. In Section 13.31 the problem considered here 
is given and the main result is shown in section f3. 41 A numerical simulation 
is presented in section 13.51 to show the effectiveness of the main result. In 
section 13.61 we draw the conclusion. 

Notations: R n denotes the n-dimensional Euclidean space. The superscript 
"T" stands for matrix transposition. The notation P > (> 0) means that 
P is a real symmetric positive definitive matrix (positive semi-definite). In 
symmetric block matrices, asterisk * is used to represent a term that is in- 
duced by symmetry. We denote by | • | the standard Euclidean norm in R n 
and by || • || the corresponding induced matrix norm in R nxn . E{x} stands 
for the expectation of x. M n denotes the set of all n x n matrices over C 
which represents the complex field. 



3.2 Quantizer 

Let x(k) be the variable being quantized. A quantizer can be described by a 
piecewise constant function q : R n — > _T, where r is a finite subset of R n with 
a fixed number of elements N. This leads to a partition of R n into a finite 
number of quantization regions of the form {x{k) £ R n : q(x(k)) = i,i € r}. 
The quantization regions can be shown as Fig. 13.11 
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Fig. 3.1 The square domain denotes the set of states being quantized. Quanti- 
zation regions are denoted by closed domains surrounding by dotted line. Every 
quantization region has a quantized value represented by a dot. 



We assume that there exist positive real number M and A such that 

I. If \x(k)\ < M, then \q(x(k)) - x{k)\ < A; 

II. If \x(k)\ > M, then \q{x{k))\ > M - A. 

Then the quantizer above is called a uniform quantizer, where M is saturation 
value and A means sensitivity. When x{k) does not belong to the union of 
quantization regions of finite size, the quantizer saturates. So Condition I 
gives a bound on the quantization error when the quantizer does not saturate. 
Condition II provides a way to detect the possibility of saturation. 



Remark 3.1. Generally speaking, quantizer q 
saturation value M is defined as 



Z with sensitivity A and 



q(x) = 



M, 
-M, 



Lf + IJ.*/ 



ifx>{M-\)A, 
ifx<-{M-\)A, 

(M - i)A < x < (M - 



i)A 



(3.1) 



It is obvious that the quantizer defined above satisfys Condition I and II and 
the quantization regions of the quantizer (|3.ip 



are rectangular 1001 ■ Because 
the quantization regions of uniform quantizer with Condition I and II have 
arbitrary shapes, the uniform quantizer is more useful and worthy to be 
considered. 

Remark 3.2. Note the quantizer defined as (|3.1[) has some differences with 
the one in [17| . In fact, based on the analysis process of system performance, 
(M + ^)A should be changed to (M — i)A in the definition of quantizer in 

P2I- 
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In this chapter, we use quantized measurements of the form in [100] . i.e. 

^(z(fc))=M%(^|) (3-2) 

where fi(k) > 0. 

It is obvious that the following conditions about g^(-) can be given: 

III. If |x(fc)| < M(i(k), then \qn(x(k)) - x(k)\ < A ( u(fc); 

IV. If \x(k)\ > Mn(k), then \q„(x(k))\ > M/*(fc) - Afi(k). 

Remark 3.3. The role of /x(/c) is to simply the analysis. In fact, for the quan- 
tizer satisfying the Condition I and II, the process of "zooming-out" stage 
is increasing M such that |q(x(fc))| < M — A, then the quantizer does not 
saturate, that is, |x(fc)| < M, according to Condition II. Based on Condition 
I, we have \q(x(k)) — x(k)\ < A. In the stage of "zooming-in" , A is decreased 
to ensure the stability of the system. When fj,(k) is introduced, we just need 
to increase or decrease n(k) rather than M and A in "zoom" strategy. 

3.3 Problem Formulation 

In this chapter, we will consider the following discrete-time linear system: 

G:x(k + l) = Ax(k)+Bu(k). (3.3) 

where x(k) € R n is the state vector, u(k) £ R n is the control input, A and B 
are matrices of suitable dimensions. Assume that A is unstable and (A, B) is 
stabilizable. 

The following control law will be considered 

u{k) = 9{k)Kq^x{k)) (3.4) 

where q^(-) is defined as (I3.2[) and 9(k) is a 0-1 random variable with proba- 
bility distribution given by 

Pr(e(k)=i) = ^ 1 ^ a i i Z° 1 \ 0<a<l. (3.5) 

when 9(k) — 0, the packet dropout occurs and the control law u{k) = 0, 
otherwise u{k) — Kq^{x(k)), that is 

Pr(u(k) = 0) = a 

Pr(u(k) = K qti (x(k))) = 1 - a [ ' 

Then system (|3.3|) with control law p.2l) can be given as 

x(k + 1) = Ax{k) + B6{k)K qil {x{k)) (3.7) 



3.3 Problem Formulation 
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We explain how the control signal is processed when it is transmitted from a 
controller to the input side of G according to Fig. 13.21 



u(k) 


■ System G - 


x(k) 


Quantizer 






















Packet dropout 
9{k) 




Feedback 
K 











Fig. 3.2 Stabilization via quantized signals with stochastic losses. 



Definition 3.4. System (|3.7p is said to be mean square stable if 

lim k ^ oa E{\x(k)\ 2 } = Q (3.8) 

for any initial state x(0) € R n . 

As we can see, system (|3.7p is affected by quantization and packet dropout 
simultaneously, then we will consider the problem of which conditions the 
packet dropout rate a should satisfy to ensure that the states of the closed- 
loop system (|3.7p is mean square stable. 



Lemma 3.5. The following inequality holds for any positive matrix P and 
matrices E and F : 

E T PF + F T PE < E T PE + F T PF. (3.9) 

Definition 3.6. [71] The spectral radius p(A) of a matrix A £ M n is 

p{A) = maa;{|A| : A is an eigenvalue of A} (3.10) 

where |A| denotes the amplitude of A. 

Lemma 3.7. \1J$ If || • ||* is any matrix norm and if A € M n , then \\ A ||*> 
p(A). 



Remark 3. 8. If the following system 

x(k + 1) = Ax(k) 



(3.11) 



is unstable, then there is at least one eigenvalue A for which |A| > 1. Based 
on Definition 13.61 and Lemma [3.71 we have || A ||*> p(A) > 1, especially, 

MH>1. 
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3.4 Main Results 



In this section, the main result is given as Theorem 13.91 



Theorem 3.9. Consider system \3. 7\ ), for a given packet dropout rate a, if 
there exist a matrix W and a positive matrix 3 satisfying 



-E (AS + B&) 1 


[BV) T 


* -|s 





* * 


1 w 

2q" 



<0 



(3.12) 



then we let K = \P '5 , the closed-loop system \3.7\) is mean square stable. 
Proof: The system (|3.7[) can be rewritten as 

x(k + 1) = (A + BK)x(k) - BKx(k)(l - 6{k)) + BK0(k)s(x(k)) (3.13) 



where the "error" vector s(x(k)) = q^(x(k)) — x(k). 

In the following, we will use "zoom" strategy in [17| and 
mean square stability of system (J3.7I) . 



to prove the 



The "zooming-out" stage: If we let u(k) = and increase /i(fc) fast enough 
to dominate the rate of growth of \\A\\ h , that is, fj,(0) = 1 and /j,(k) = \\A\\ k , 
then based on || A ||> 1, there exists a positive integer k such that 



x(k) 



m 



< Ma 



A-max 1/ ) 



-2A 



hence 



z(fc) 

q ^(k)> 



< 



x(k) 



!*(*) 



A < Ma 






A 



Thus, we can define 



fco = mini k > 1 



q( 



x(k) , 



< Ma 



^min \* ) 
Amax \-l ) 



A 



It is obvious that 



q( 



jg(feo) ■ 

/i(fc )' 



< Ma 



Amax \± ) 



A 



hence 



that is 



x(k ) 



n(ko) 



< 



q( 



x(k ) . 
H(k ) 



+ A<Ma 



*min\P) 
"max I,-* J 



\x(k )\ <Mfx(ko)A 






(3.14) 
(3.15) 

(3.16) 

(3.17) 
(3.18) 
(3.19) 
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Therefore, x(k ) belongs to the ellipsoid 

7?i = {x(k) : x T {k)Px{k) < M 2 ^(k )\ mm (P)} (3.20) 

In the following part, we will prove that R\ is a invariant region, that is, if 
we let u(k) = 9{k)Kq^^x(k) with /i(fc) = /u(fco) for k > fco, then x(k) will 
not leave R\. 

Based on (|3.20p . it is obvious that 

\x(k)\<Mfi(k) (3.21) 

holds with n{k) = /x(fco) for all x{k) £ R\, which means the quantizer does 
not saturate, then based on the Condition III, we have 

\s(x(k))\ < A/i(fc) (3.22) 

for all x(k) £ R 1 . 

Let V(x(k)) = x T (k)Px(k), where P = S^ 1 , it is obvious that P is a 
positive matrix. 

Based on ^Hft and E{(6(k)) 2 } = E{9(k)} = 1 - a, we have 

AV(x(k)) 
= E{x T (k + l)Px{k + 1)} - x T (k)Px(k) 
= x T (k)[(A + BK) T P(A + BK) -P + aK T B T PBK 

-aK T B T P{A + BK) - a(A + BK) T PBK]x(k) (3.23) 

+ (1 - a)s T (x(k))K T B T PBKs(x(k)) 

+ (1 - a)s T (x(k))K T B T P{A + BK)x{k) 

+(1 - a)x T (k)(A + BK) T PBKs{x{k)) 

Let E = -BK, F = (A + BK), M = BKs(x(k)) and N = (A + BK)x(k), 
the following inequalities can be given by Lemma 13.51 

1 TS\T DDT/ 

(3.24) 



(3.25) 



-aK T B T P(A + BK) - a{A + BK) T PBK 

< aK T B T PBK + a(A + BK) T P(A + BK) 

(1 - a)s T (x(k))K T B T P(A + BK)x(k) 
+(1 - a)x T (k)(A + BK) T PBKS(x(k)) 

< (l-a)s T (x(k))K T B T PBKs(x(k)) 
+(1 - a)x T (k)(A + BK) T P(A + BK)x(k) 

Based on (|3~23|) . ([3~2"4")l and ([3"T2"5]) . it is obvious that 

AV{x(k)) < x T (k)[2(A + BK) T P(A + BK) -P + 2aK T B T PBK]x(k) 
+2(1 - a)s T (x(k))K T B T PBKs(x(k)) 

(3.26) 
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Define A — diag{P, 1, 1} and pre-multiplying and post-multiplying (13.12J) by 
A give 

' -P (A + BK) T {BK) T ' 

< (3.27) 

Then based on Schur complement and (|3.27|) . we can see that 

2(A + BK) T P(A + BK) - P + 2aK T B T PBK < 0, (3.28) 

which means that there exists a positive matrix Q, such that 

2(A + BK) T P(A + BK) -P + 2aK T B T PBK = -Q < (3.29) 

Then 

A(V(x(k))) 

< -x T (k)(Q)x(k) + 2(1 - a)s T {x{k))K T B T PBKs{x{k)) (3.30) 

< -A TM „(Q)|x(fc)| 2 + 2(1 - a) || K T B T PBK \\ A V(*0 

The last expression is negative outside the ball B = {x (k) : \x(k)\ < <PApi(k)}, 

where 

i 

*=( 2 -T-^\\K T B T PBK\\Y (3.31) 

Define the scaling factor Q by the formula 



"■max (,-* ) 



f2=J ,)' V^+eAM- 1 (3.32) 

y \nin(P) 

for some fixed e > 0, and take M of A to be large enough such that Q < 1, 

we have R\ D B and R\ is a invariant region. It follows that if we let u(k) = 

9{k)Kq IM n.\x{k) with fj,(k) = /x(fco) for k > fco, then x(fc) will not leave i?i. 

The "zooming-in" stage: 

Define 

_ = M 2 X mm {P) - A 2 $ 2 \ max (P) 

Knin(Q)A 6 

Since Q < 1, it is easy to see that f > 0. Define r = |~f], where [•] denotes 
the smallest integer which satisfying r > f, it is obvious that r G Z>o. 
We claim that the following inequality can be given for the r defined above, 

E{x T (k Q + T)Px(k + t)} < A V(fco)(<£ 2 + e)\ max {P) (3.34) 

where e is defined in (|3.32|) . 
Define 

R 2 = {x(k) : E{x T (k)Px{k)} < A 2 M 2 (fc )(# 2 + e)A meKC (P)} (3.35) 
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It is obvious that i?2 is a invariant region based on R2 D B for all ko < k < 
fco + t. Suppose that (|3.34p is not true. Then for r £ Z>q, we have 

E{x T (k + T)Px(k + r)} > AV 2 (fco)(^ 2 + e)\ max (P) (3.36) 

Therefore 

E{\x(k)\ 2 }>A 2 f, 2 (k Q )(<I> 2 +e) (3.37) 

for all ko < k < ko + t. Based on (I3.30[) and Q < 1, we can see that 

AV(x(k +T-l)) 
= E{x T {ko + T)Px(k + t)} - E{x T (k + r - l)Px(k + r - 1)} 

< -A mm (O)-B{|a;(fc + r - 1)| 2 } + A mm (Q> 2 A 2 /i 2 (fc ) (3.38) 

< -A mm (Q)A V(fc )(<2> 2 + e) + A mm (Q> 2 A V(fc ) 
= -A mm (g)AV 2 (fc )e 

Similarly, we have 

AV(x(k + t - i)) 

= E{x T (k + r-i + l)Px(k + t - i + 1)} 

-E{x T {k +T-i)Px(k + T-i)} (3.39) 

< -X mi n(Q)E{\x(ko +t- i)\ 2 } + A mm (Q> 2 A V(fc ) 

< -A mm (Q)AV(fc )e 

where i £ {1, 2, 3, • • • , r}. 

Then the following inequality can be given 



E{x T (k^ + T)Px(k Q + t)} - x T (k )Px(k a ) 
< -A mm (Q)AV(fc )e-r 
<-A mm (Q)AV(fc )e-r 
= A 2 <P 2 \ max {P) l j 2 {k ) - M 2 \ mm (P)v 2 (ko) 



(3.40) 



But ([3^20)1 . ([3~36|) imply that 

AV(x{k Q )) = £{x T (fc + r)Pa;(fc + r)} - x T {k )Px(k Q ) 

> AVM^ 2 + e)A ma x(-P) - fi 2 (k )M 2 X mm (P) (3.41) 

> A 2 <P 2 A max (P) M 2 (fc ) - M 2 \ mm (P)v 2 (k ) 

Comparing (J3.40D and (|3.4ip . we arrive at a contradiction, which establishes 

the validity of (J3T34|) . 

Based on Q < 1, for the t G .Z>o, we have 

E{x T (k + T)Px(k + t)} < A 2 n 2 (k )($ 2 + e)\ max {P) 

< (f2v(k )) 2 M 2 \ mm (P) [ ' 

that is 

E{x T (k Q + T)Px(k Q + t)} < (nn(k Q )) 2 M 2 \ mm (P) (3.43) 
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Then x(ko + r) belongs to 

R 2 = {x(k) : E{x T (k)Px(k)} < {Q^(k )) 2 M 2 X mm {P)} 



(3.44) 



Thus we let u(k) = K9q fi (x(k)) with /i(fc) = f2/i(ko) for ko + r < k < fco + 2r, 
similar to above analysis, we have 

E{x T (k + 2r)Px(k a + 2r)} < (Q 2 fi(k )) 2 M 2 \ min (P) (3.45) 

Similarly, let n(k) = fi l /j,(ko) for kg + (i — l)r < k < ko + ir, we have 

E{x T {k + iT)Px(k Q + it)} < (r?V(fc )) 2 M 2 A mm (P) (3.46) 

Repeating this procedure, it is obvious that /i(fc) — + as k — > oo which 
means i — + oo, and the closed-loop system (|3.7[) is mean square stable, that 
is, Um k ^ooE{\x{k)^} = 0. ■ 

Remark 3.10. According the proof of Theorem 13.91 if the initial state x(0) is 
not saturate, then we can omit "zooming-out" strategy and select fco = 1. 

Remark 3.11. As we can see, the packet dropout just occurs at the input side 
in the above analysis. Then what will happen if the packet dropout exists at 
the both sides of the input and output? In the following, we will consider the 
system shown as Figjj 
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Fig. 3.3 Stabilization via quantized signals with stochastic losses occurred at the 
both sides. 



Where g^(-) and 0(-) are defined as above and x(k) = ip(k)x(k), where cp(-) 
is a 0-1 random variable with probability distribution given by 



Pr(ip(k) = i) 



0, 



0. 



1-I3,i = l, 



0</3< 1. 



(3.47) 



3.5 Numerical Example 
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When <p(k) = 0, the packet dropout occurs and x(k) — 0, otherwise 
x(k) = x(k). 

It is easily to see that the control law u(k) — 9(k)Kq^(ip(k)x(k)) has the 
following property: 



u{k) 



when 9(k) = 0, (f(k) = 

when0(k) = l,ip(k) = O 

when 6{k) = 0, ip(k) = 1 

Kq^(x(k)) when 0(k) — l,tp(k) = 1 



(3.48) 



that is 



Pr(u(k) = 0) = a + (3 - a/3 

Pr(u(k) = Kq^(x(k))) =l-a-£ + a/3 



(3.49) 



Comparing (13.49)) with (|3.6|) and based on Theorem 13.91 it is obvious that 
for the given packet dropout rate a and /3, if there exist a matrix \P and a 
positive matrix S satisfying 



-S (AS + B^) 1 



I" 

2" 



(M) T 

o 

i ~ 

' 2{a+f3-afj)- 



<0 



(3.50) 



let K = If^ 1 , system ()3.3|) under control law u(fc) = 6(k)Kq^(ip(k)x(k)) is 
mean square stable. 



3.5 Numerical Example 



Example 3.12. In this example, we consider an application of the method 
proposed in this chapter to the following discrete-time system 



x{k + l) =Ax(k) + Bu(k) 



where 



.4 



0.1 


-0.4 





1.5 


0.1 


0.1 



0.2" 




"0.5 " 


0.1 


B = 


0.5 1 


0.1 




1 0.5 



(3.51) 



(3.52) 



The eigenvalues of A are 0.0022+0.1156i, 0.0022-0. 1156i and 1.4956, it is 
obvious that the system (I3.51[) is unstable. The system is stabilizable since 
rank[B AB A 2 B] = 3. 

If packet dropout rate a = 0.2, there exist positive matrics 



0.7244 -0.0287 0.0020 

-0.0287 0.5054 0.0223 

0.0020 0.0223 0.7033 



(3.53) 
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and 



$ = 



-0.1119 0.3407 0.1232 
0.0893 -0.7548 -0.0481 



(3.54) 



satisfying (|3.12p . then system p.51[) under control u(k) = 8(k)Kq li (ip(k)x(k)) 
is mean square stable based on Theorem 13 .91 and K is defined as 



K = 



-0.1288 0.6600 0.1546 
0.0643 -1.4889 -0.0213 



Here, the quantizer is selected as 

n (t (h\\ - / ^(k)sgn{x t (k)}, if \x t (k)\ > 3/x(fc), 



(3.55) 



(3.56) 



where Xi(k) is the ith component of x{k) and sgn{xi(k)} is a symbolic func- 
tion. It is obvious that Condition III and IV are satisfied with M — 3 and 
A = 0.5. 

When e = 0.1, we have Q = 0.6660 < 1. Let initial state x(0) = [7 8 7] T 
and ju(fc) =|| A || fc , it is obvious that x(0) is saturate, that is, |x(0)| > Mfi(0). 
Then based on "zooming-out" strategy, a unsaturate time fco which satisfying 
(|3.19|) can be shown as Fig. 



•*•■ L(k) 
■*'• lx(k)l 



Fig. 3.4 The selection of kg. 



1 1.5 2 2.5 3 3.5 4 4.5 



In Fig. EEH L(k) = Mfi(k) 



and fco = 3 is the smallest k satis- 



A max (p) 

fying (|3.19|) . Then based on "zoom" strategy, /i(k) can be shown as Fig. I3.5I 
according to fco = 3 and r = 1. 

Then the mean square of x(fc) can be shown as Fig. 13.61 and system (|3.51[) 
is mean square stable. 



3.5 Numerical Example 
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Fig. 3.5 jtt(fc) in "zoom" strategy. 
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Fig. 3.6 The mean square of x(k). 



Remark 3.13. Note that when u(k)=8(k)Kq tl (ip(k)x(k)) 7 the states of closed- 
loop will be influenced by random variable 9{k), then the states trajectory will 
be random. Therefore, the kg selected is random and /i(fc) must be adjusted 
according to kg. 

Remark 3.14- If the initial state is selected as x(0) = [12 1] T , then based on 
Fig. 13.71 fco is selected as 1 and the "zooming-out" strategy can be omitted. 

If packet dropout rate a = 0.3, we have 



-S(A3 



- B&f (B&) T 

r 1= 

2a" 



>0 



(3.57) 
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■•■■ L(k) 

■•" lx(k)l 



1 1.5 2 2.5 3 3.5 4 4.5 



Fig. 3.7 The selection of ko. 



for all matrices <P and positive matrices 5, so Theorem I3.9I is not useful to 
verify the mean square stability of system (|3.51|) . 

Remark 3.15. In fact, when initial state x(0) = [7 8 7] T , we can solve the 
largest packet dropout a rs 0.2741 to ensure the mean square stability of 
the closed-loop system (|3.51[) . that is, if the packet dropout rate a < 0.2741, 
the closed-loop system (|3.51[) is mean square stable, otherwise, Theorem 1 is 
invalid to verify the mean square stability of system (I3.51[) . 



3.6 Summary 

In this chapter, the problem of mean square stability of linear discrete sys- 
tem with quantization and packet dropout is considered. For a given packet 
dropout rate, a sufficient condition is given to ensure that the closed loop 
system is mean square stable. The "zoom" strategy is used here, which was 
based on the hypothesis that it is possible to change the sensitivity A/x(fc) 
and saturation value M/j,(k) of the quantizer. Based on (J3.12D and (I3.50p . the 
largest packet dropout rate can be given to ensure the mean square stability 
of closed-loop system. However, the condition given in main Theorem is a 
sufficient one, the sufficient and necessary is worthy to be considered in fu- 
ture. Because the form of packet dropout considered in this chapter is simple, 
some "representation complexity" of packet dropout needs to be developed 
and taken into account. The system considered here is linear discrete, so the 
nonlinear systems can be studied in future. 



Chapter 4 

Stabilization of Systems with 

Quantized Feedback and 

Measurements 



4.1 Introduction 

As we know, two quantizers are used frequently. The uniform quantizer is 
introduced in above chapter, as for logarithmic quantizer, wonderful results 
have been obtained. In [JHIj a logarithmic quantizer is firstly presented for sta- 
bilization of a linear discrete-time system. Ref. [51] shows an alternative proof 
for the optimal design and extends the results to quantized output feedback 
and quantized quadratic performance control using the sector bound method. 
Output feedback control of discrete-time linear systems using a finite-level 
quantizer is studied in |52| . A new approach based on sector bound method 
is used to analyze the stability of quantized feedback control systems in 
|237j . Remote control system affected by quantized signal is considered in 
[86] , Based on a quantization dependent Lyapunov function, the study on 
stability analysis of quantized feedback control system is given in [55]. The 
problems of discontinuous stabilization and robust stabilization of nonlinear 
systems are discussed in [3T] and [139] , respectively. Ref. [ST] considers the 
problem of dynamic out-feedback stabilization of NCSs. In [55] and [57], the 
adaptive quantized control is considered and an adaptive feedback control 



law is given to ensure Lyapunov stable and x(k) — > as k — > oo. In |185j . 
quantization and packet dropout are considered simultaneously, packet losses 
rate and unstable poles of the plant are considered to ensure different stabil- 
ity of the system, such as stochastically quadratically stable and mean square 
practically stable. 

Note that most of results just considered the network exists at one side of 
systems, i.e. input inside or output side. In fact, the network always exists 
at the both sides in practice. So a quantized input computed from quantized 
measurements (QIQM) system in accordance with network exists at both 
sides is necessary to be considered. 

In Ref. [223], the guaranteed cost control design (GCCD) problem of linear 
system, which is affected by both quantized input and quantized output, is 
considered. Based on linear matrix inequation, a sufficient condition is given 

Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 49J-71-I 
springerlink.com © Springer- Vcrlag Berlin Heidelberg 2011 
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to ensure the GCCD problem for system with a network-based quantized 
controller is solvable. Ref. [25 investigates the case of feedback control sys- 
tems subject to both input and output quantization. Based on sector bound 
approach, a sufficient and necessary condition for quadratic stabilization of 
closed-loop system is given. But the condition given in [33) is hard to verified 
because of the uncertainty of variables. So, in this chapter, another method, 
which is proposed in [146] , is used to analyze the stability of closed- loop sys- 
tem. Note that quantizer used in |146| is a uniform one, which is simpler 
implement but holds lower performance compared to logarithmic quantizer. 
Therefore, in order to improve the performance of system, the logarithmic 
quantizer is more useful than uniform quantizer when network exists at the 
both sides of system. 

In this chapter, the globally asymptotic stability of QIQM system is ana- 
lyzed and a sufficient condition is given to ensure the stability. The quantizer 
used here is a logarithmic one and a nonnegative and bounded multiplier 
plays an important role in the process of stability analysis. Attention of this 
chapter is restricted to linear discrete-time system, which is open-loop stable 
and affected by network at both input and output sides. Note that network is 
necessary to be inserted although the open-loop is stable in some situations, 
such as remote control system. Therefore the problem considered here holds 
it's own practical meanings. 

The contents of this chapter are as follows. In Section 14.21 we introduce 
QIQM system and quantizer used in this chapter. In Section FOl the stability 
of system is analyzed and a sufficient condition is given for globally asymp- 
totically stable of closed-loop system. A numerical simulation is presented in 
Section 14.41 to show the effectiveness of the main results and the conclusion 
is drawn in Section 14.51 



4.2 QIQM System Description 

In this chapter, we will consider the system with network exists at both 
input and output sides. Because of the existence of network, quantization is 
necessary to be considered and framework of system can be shown as Fig. 14.11 
The system shown as above can be seen as a QIQM system: 

( x(k + 1) = Ax(k) + Bu(k) 
: 1 u(k) = -Q(FQ(x(k))) ^ A) 

where x(k) is the n-dimensional state vector, A is a square matrix with 
eigenvalues inside the unit circle, B is an n-by-1 vector and F € R nxl is a 
state feedback matrix. The mapping Q : R — > R is a logarithmic quantizer 



4.2 QIQM System Description 



51 





«(*), 


Plant 


x(k) t 


Quantizer 1 


t(x(ky 
























■ 




Network 


















u(k) 


Quantizer 2 


Ft(x(k)) 


Feedback 


((#)) 













Fig. 4.1 System description. 



with a dead-zone around origin. Similar to quantizer used in |185j . Q(-) can 
be expressed as: 



Vi, z e [^Vi, ^Vi) 



In "*> 2 

_£+l 

2 V 

0, z £ (—v,v) 



Q{z) = { -v h ^(-f^-fu, 



Vi = P 1 vq,v > 0,i e Z> . 

Where the coarseness p > 1 and v — ^-vq. 

The logarithmic quantizer Q(-) can be shown as Fig. 



(4.2) 




Fig. 4.2 Logarithmic quantizer with dead-zone. 



The mapping Q : R n — ► _R" is the vector quantization function satisfying: 
G(a:) = £,i/;feere& = Q(a;i). (4.3) 
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Remark J^.l. Note that the logarithmic quantizer considered here is different 
from traditional quantizer used in [40j and [51j , where quantization coarseness 
p < 1 and quantization levels decrease monotonously. But in this chapter, 
quantization levels increase monotonously according to p > 1. In fact, the 
quantizer described as (|4.2p is the same as traditional quantizer essentially 
and p considered here is equal to - in [30] and [ST]. Comparing to I185| . 
quantization regions are different from each other, but the changes do not 
influence the performance of quantizer. The changes here are just to facilitate 
the discussion. 



4.3 Stability of QIQM System 

4-3.1 Construction of an Equivalent System and a 
Multiplier 

Define the following system: 

T . J x(k + 1) = Ax(k) + Bu(k) . . 

1 ■ \ y{k) = Fx(k) + du{k) { ' 

where u(k) is the same as u(k) defined in l|4.1|l and d is a parameter to be 
determined, it is obvious that the state trajectory of (|4.4|) is equal to the one 
of (14. fp according to the same initial state. 
Then we have the following Lemma. 

Lemma 4.2. There exists a mapping a : R n — * R, called multiplier , such 
that 

u(k) = -Q[a{x{k))y(k)] = u(k), Vfc (4.5) 

Proof: Let 

n Vi = {x(k) € R n \Q(x(k)) = Vi} 

F = {x(k) e R n \Fx(k) = 0} (4.6) 

A = Q Q n F 

We will show that there exists a mapping a(x(k)) satisfying Q[a(x(k))y(k)] = 
Q[FQ(x{k))\, then the result is satisfied. 

If Q(FQ(x(k))) > 0, all we should do is to illustrate that there exists a 
mapping a(-) such that 

^±Q(FQ(x(k))) < a(x(k))y(k) < P±±Q(FQ(x(k))) (4.7) 

In fact, if x $ A, then there exists an appropriate d, such that 

y(k) = Fx{k) - dQ(FQ(x(k))) > {or < 0) (4.8) 



4.3 Stability of QIQM System 53 

Then (|4"77|) is equal to 
p±l 

2p Fx( 



p+1 Q(FQ(x(k))) < , > x / m \ , / . >, p+1 Q(FQ(^(fc))) 
c(fc)-dQ(fQ(x(fc))) - ^° r -J "W^J < 10^ >) ~2~ Fx{k)-dQ(FQ{x{k))) 



(4.9) 

Let 

a(4fc)) = QiEQWm (4 io) 

a(XW) Fx(k)-dQ(FQ(x(k))) l4 ' iUj 

It is obvious that a(x(A;)) defined above satisfies (14. 5|) . 

If ic G A, then Q[a(x(fc))y(fc)] is equal to Q[FQ(x(k))] for any a(x(k)), we 
let a(x(fc)) = for simplicity. 

If Q(FQ(x(k))) < 0, the proof is the same as Q(FQ(x(k))) > and 
a(x(k)) is defined as ([iTID]) . 

Last, a(x(fc)) can be chosen as when Q(FQ(x(k))) = 0. 

Based on the proof of Lemma [4.21 the multiplier a(x(k)) is defined as: 

a {x{k)) = ^ Fx(k)-dQ(FQ(x(k)))' l J X * (4.H) 

10, if x E A 



4.3.2 Weil-Defined Multiplier 

Note that the selection of <i should be considered in the proof of Lemma 
14.21 now we will show that there exists a suitable d such that Fx(k) — 
dQ(FQ(x(k))) = if and only if a; € A 

In the following, two-dimensional system is discussed for simplicity. Firstly, 
we consider sup xe ^ Fx and infaseft Fx, where 77 = [771 r)2\ T and 771,772 € 
{±u»,i € Z>o}. 

Because Fx is linear, sup^g^ Fx and inf^g^ Fx should happen on the 
edge of Q v . 

For 77j = Vi > 0, j = 1, 2 and i e Z>o, we have 

m ax,^(f€'" + ^-"- >0 (4,2) 



Otherwise, if rjj = —Vi < 0, 



^Vi - *&Vi if h > 



maxx^ , 4p « 4p " J •" (4.13) 

l^^ + V^ ^ <0 

where p ^ ' rjj is the middle point between ^—T)j and ^-rjj and p 4 ~ |?jj| is 
the distance between the middle point and boundary points. 
Then based on P~T2"|) and (|JTT5|) . we have 

max &j = — A Vj + S9n(fj)—. \Vj\ (4-14) 

xj£U v 4p 4(0 
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for any fj and rjj, where sgn(-) is a symbolic function. Then 

sup Fx = VP \ ; Fr)+— A FnL (4.15) 

Note that Q(FQ(x(k))) — Q(Ft]) when x E Q v . In the following, we will 
show that there exists a suitable d such that 

F d = {x(k)\Fx(k) = dQ{Fr,)} n ^ = (4.16) 

That is, the denominator of a(x(fc)) can not be zero in J7^ and it can not be 
zero for all x(k) except for J?o according to the arbitrary of 77. 

To verify (|4.16|) . we discuss the value of || Fr\ ||i for sub- four cases: 

i) When 771 = Vi > and 772 = Vj > 0, the quantization region fl^ can 
be shown as Fig. 14.31 Note that sup xefi Fx can be realized at a\, b\, c\ or 
d\. Assume that sup^g^, Fx IS achieved at a\ and there exists a suitable d 
such that the distance between F n and Fd is larger than the one between 
F v and sup^g^ Fx, then (|4.16[) is satisfied. It is obvious that if sup^g^ Fx 
is achieved at b±, c\ or d\ rather than a\, d selected above can also ensure 
(J4.16D . So, the case, sup^g^ Fx is achieved at aj., is only considered. 

When sup^g^ Fx is achieved at 01, f\ > 0, fi > should be satisfied. 
Then 

\\Fr 1 \\ 1 = \f im \ + \f 2 r l2 \=F V (4.17) 

ii) For 771 = Vi > and 772 = —Vj < 0, the quantization region is illus- 
trated as Fig. 14.41 The same as above analysis, we only consider the case that 
sup x£ f2 Fx is achieved at d 2 and then /1 > 0, f 2 < 0. Again, we have 

\\Fr)\\i = Fr) (4.18) 

As for rj = [—Vi Vj] T and r\ = [—Vi —Vj] T , the case, sup x g r2 Fx is achieved 
at b 3 and C4, is considered respectively and H-F^Hi = F-q. 

Above all, we can see that the case, \\Fr]\\ 1 = F77, is only discussed whatever 
77 chooses. Then there is no point of intersection between f2 v and Fd, that is 
(|4.16|) is satisfied, is equal to 

\F V - sup^ Fx\ < \F V - dQ{Fn)\ 
«*• Wv - i£ ^Fv - ^H^IKI < \Fv - dQ{Fr,)\ (4.19) 



ip ± 'I ip 

2±i2l/r„ _ p—1 

i P £ 'I i P 



«• Wv - ie ^-Fv ~ 4^1 < \Fv - dQ(F V )\ 



Let p = i±|, (ji?Tg|) is changed to 



Fr/| < |F»7-dQ(Fr7)| (4.20) 



l-<5 
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^ ip J \F={x\Fx=Ftj} 



Fig. 4.3 Quantization region. 



\- E ^r,/F ri ={x\Fx=Fi 1 } 




Fig. 4.4 Quantization region. 
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F ={x\Fx=Fr/} 



Fig. 4.5 Quantization region. 
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-— v. 

2 



n. 
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(-v„-v,) 
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■£±lv. 

2p 



t/„ 



Fig. 4.6 Quantization region. 



According to < <5 < 1 and there exists an uncertain variable A such that 
Q(Fr)) = (1 + A)Frj, where |A| < 5 [5L, (|4~^D|l is equivalent to 



j^\F v \ < |1 - d(l + A)||Ft,| «• ^ < |1 - d(l + A) 



(4.21) 



Assume d < 0, it is obvious that 1 — d(l + A) > and the inequation above 
is equal to 

J< (1-^x1% <« 2 > 
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1-2.5 
(1-5)(1 + A) 



When 1 — 2(5 > 0, that is < S < |, n_g)(i+A) decreases when A increases. 
Then (|4.22|l is satisfied if and only if 



d < [-| (4.23) 

Otherwise, if 1 — 2<5 < 0, that is | < 6 < 1, m-MiIa) i ncreases as l° n g as 
A increases. Then (|4.22[) is equivalent to 



1-25 



d<— -jrr (4.24) 



Summarized above, it is obvious that (I4.22[) is equal to 



1-2A" 



U if < 5 < I 



d<f(6)±\ \-^ s V f \y x -» (4.25) 



W */ 5<<^< 1 



Note that d < is assumed, d has to satisfy 

d<mm(0, /(<*)) ^ (/(<$) = ( i-2S % L ?<*^! (4.26) 

I 7J^5F ■* 2 - ° < X 

In the above, sup x6 ^ -Fa; is considered. As for inf x6 f2 Fa;, if t)j = i>j > 0, 
j = 1, 2 and i £ ^>0j we have 

mi„, i = (S'"'-1%" i/A>0 (4.27) 

Otherwise, if % = — Vi < 0, 



/ Lefl-vj + ^m if fi > o 

mm ai, = < , *^ 2 2 P , 

Combining (|4~27|l with (g^gj) , we have 

(P+l) 2 ■ ,,^-1 



(4.28) 



mm Xn 



for any fj and ^-. Then 



m - signtfj)^- — \ m \ (4.29) 



inf Fa: = ^t Fri-2-r —\\Frjh (4.30) 
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In the following, we discuss the value of || Frj |ji for sub-four cases: 

i) When 771 = Vi > and 772 = Vj > 0, the quantization region fi^ can 
be shown as Fig. 14.31 Note that inf x6 ,Q Fx can be realized at a%, 61, c\ or 
d\. The same as the above analysis, the case, inf^g^ Fx is achieved at 01, 
is just discussed. 

When inf xeJ 7 Fa: is achieved at 01, /1 < 0, f% < must be satisfied. Then 

ll^lli = l/U7i| + l/a»fc| = -Ft, (4.31) 

ii) For r/i — Vi > and 772 = — Vj < 0, the quantization region is shown as 
Fig. 14.41 Then we only consider the case that mi x€ Q Fx is achieved at di 
and then fx < 0,f 2 > 0. Again, we have 

\\Fri\\i = -Fr l (4.32) 

As for 77 = [—Vi Vj] T and 77 = \—Vi — Vj] T , the case, inf^g^, Fx is achieved 
at b 3 and C4, is considered respectively and ||Fr7||i = — F77. 

Above all, we can see that the case, ||Fr7||i = — F77, only need to be con- 
sidered whatever 77 chooses when inf^g^ Fx is discussed. Then there is no 
common point of intersection between fl^ and F^, which means 



IF77 - inf x g fi?? Fx\ < \Ft) - dQ(F V )\ 

4p r 'I ^ ip 

2±H!p„_ p!^ 1 
i P ± 'I i P 



«• l^-^^ + ^ll^llil < \Fr,-dQ{Frj)\ 



(4.33) 



<3> (143511 

Then the same as above analysis, d defined as (I4.26[) can ensure (J4.16D . 
Therefore, the following condition can be given. 

Corollary 4.3. The multiplier a(x(k)) in 07771) is well-defined if 

Remark 4-4- Note that all analysis above just shows that if x $. Qo> then 
a(x(k)) is well-defined when d < g(6). Comparing to a(x(k)) defined in (14.111) . 
we should also prove that a(x(k)) is well-defined if x(k) € {2q\Fq. In fact, the 
result is obvious. If x(k) <G J?o\F), it is easy to see that Q(FQ(x(k))) = 
and Fx(k) ^ 0, then Fx(k) - dQ{FQ{x(k))) = Fx(k) ^ for any d. 



4-3.3 Nonnegativity of Multiplier 

In this section, nonnegativity of a(x(k)) is discussed and one Lemma is given. 
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Let x{k) £ O v , then Q(FQ(x(k))) is equal to Q(Frj) and 

is a function of Fx(k). Note that a(ir(fc)) has singular points satisfying 
Fx(k) = dQ(Fri). When d < g(6), these singular points are not in f2 v and 
a(x(k)) is monotonic in i? v based on 

da(x(k)) QjFrf} 

dFx(k) (Fx(k) - dQ(Fr))) 2 [ ' 

It is obvious that a(x(k)) increases monotonously when Q(Frj) < and 
a(x(k)) decreases monotonously when Q(Frj) > 0. 

Lemma 4.5. Suppose d is chosen such that d < g(§), then a{x(k)) > for 
allx{k)eR n . 

Proof: Suppose x(k) £ il n , where r\ = {±Vi,i £ Z>q}. When d < g(S), 
the multiplier a(x(k)) is well-defined and a(x{k)) > if and only if 
infj;(fc) e f2 a(x(k)) > 0. Three cases are considered to verify the result. 

Case 1: F-q > v 

It is obvious that a{x{k)) decreases monotonously with Fx(k) and denomi- 
nator of a(x(k)) is a positive definite constant within fl rj . 
Then infj^g^ a{x(k)) > is equal to 

sup F{x{k)) - dQ{Fr]) > (4.37) 

x(k)£H v 



In fact, 



su P^(fe)er2, F(x(k)) - dQ(Fn) 
( - s± ^F v +^\\Fr,\\ l -dQ(Fr l ) 



>(&l Fr]+ ^L Fr] _ dQ{Fr]) (4.38) 

= [ T L--d(l + A)}Fr 1 

> 

where |A| < 6 < 1. The last inequation is based on d < and Fr\ > 0. Then, 
(|4.37l) is satisfied and a(x(k)) > in n v . 

Case 2: F-q < -v 

In this case, Q(Frj) is negative definite and a{x{k)) increases monotonously 
with Fx(k). In order to verify a(x(k)) > 0, the following inequation should 
be satisfied: 

inf F(x(k)) - dQ(Fr/) < (4.39) 
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In fact, 

inf*(fe)eJ2„ F ( x ( k )) - dQ(Frj) 
= i£ W 1 Fv-^ L \\F V \\ l -dQ(Fr,) 

< ^FV ' ^Frj - dQ(F V ) (4-40) 
= [ I L s -d(l + A)]Fr ] 

< 

where |A| < 5 < 1. The last inequation is based on d < and Fr\ < 0. Then, 
(J4.39I) is satisfied and a(x(k)) > in Q v . 

Case 3: — v < F-q < v 

It is obvious that a(x{k)) — in this case. 

Above all, we have a(x(k)) > for x(k) £ il n . Then for any x(k) £ R n , 
a{x(k)) is nonnegative based on the arbitrary of r\. ■ 

4.3.4 Boundedness of Multiplier 

In the following, we discuss the boundedness of multiplier a(-) and show that 
the least upper bound of a(-) exists. 

If F-q > 0, then Q(Frf) > and a(-) decreases monotonously in Q n . 
Therefore 

8u Px(k)£ ^a(x(k)) = int J^tdQW 

= Q(Fy) (4.41) 



can be seen as a function of Fr). 

Let a = sup„ sup^g^ a(x(k)), the boundedness of a is discussed based on 
graphic method. 

Select v = 1 > 0, p = 1.5 > 1 and d = -0.5 < 0, then v = ^-w = 0.8333 
and the following graphic, Fig. 14.71 can be given 

Then, we can see that the supremum of a(-) is achieved at Fr/ ~ v and a 
can be given as 

a = sup,, sup^g^ a(x{k)) 

Q(Fri) 

= sup r ; 



J V inf^fc)^ Fx-dQ(F V ) 

Q{F n ) 

P " ^F.-^Fn^ciQiF,) (4.42) 

, Hfl 

4 P v- !L Tr v-dv a 

V 
(p+l) 2 -4dp a 
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Fig. 4.7 Variations of Multiplier. 



As for Fr] < 0, Q(Frj) < and a(-) increases monotonously in il n . Then 

s ^Px(k)en v a{x(k)) - '-^-± 



sup l(l )en, Fx-dQ(Fr,) 
Q{Fr,) 

'-^Fn+e^WFnU-dCKF-n) 



(4.43) 



Note that su-V x (k)en ct(x(k)) can be seen as a function of Fr] also. Let 



a = sup sup a(x(k)) 
n x(k)eO n 



(4.44) 
and variations of multiplier selected as above, Fig. l4.8l can be shown as follows 
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Fig. 4.8 Variations of Multiplier. 
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Then, when Frj = —v, a can be achieved and shown as 
a = sup r , su P:r(fe)er2?7 a(x(k)) 






dp 



-f+ P 4„ f + rffQ 



_v 



(4.45) 



(p+l) 2 -4dp 2 

a 



Above all, if there exists r\ such that Frj = v or F77 = —v, then the least 
upper bound of a(-) exists and equals to , +1 -)f_ 4l j a ■ 

But, what will happen if there does not exist 77 such that Frj — v or 
i 71 ^ = — vl We will explain that the least upper bound of a(-) exists although 
the rj, which satisfies Frj = v or Fr\ = —v, does not exist. 

If there does not exist r\ such that Frj — v or _Fr7 = — v, we will find the 
node rj g {±Vi,i € Z>q}, for which the contour approaches the value v or 
— u. Mathematically, define the set 



F = {Frj\ri e Z n = ±p i v 0) i £ Z> , Ftj>v = ^— tj } (4.46) 



p+l 

2p 



and 



F = {F^r, £Z, = ±p i v ,i £ Z> ,Frj < -v = -^—v ] (4.47) 

Zp 

We claim that the infimum of F exists for any F. In the following, r/j > 0, j = 
1 , 2 is considered only and other cases can be analyzed similarly. 

Case 1: If /1 > and f^ > 0, then Frj > ^—vo is equal to 

fip l v + f2P J v > ^v (4.48) 

2p 

If i, j are selected large enough, then the above inequation is satisfied and it 
is obvious that there exist suitable i, j such that 

fip'vo + f2P 3 v = infj/i^Tjo + f 2 p j v } = inf F (4.49) 

Case 2: If /1 > and / 2 < 0, then Frj > ^-fo is equal to (|4.48|l . If i and j are 
selected large enough and small enough respectively, then (|4.48[) is satisfied 
and there exist suitable i and j such that 

hp~ i v + f2f?v = vnlF (4.50) 

Case 3: As for f\ < and ji > 0, the analysis is the same as case 2. 
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Case 4: If f\ < and f% < 0, then F-q < —Q^-vq can be changed to 

(4.51) 



2p 



(-/i)/° 4 «o + (~f2)p'vo > —^—vo 



2p 

and i, j selected large enough can ensure the above inequation. Therefore 
there exists suitable i, j such that 

(-fi)p l v + (-/ 2 )p»«o = inf{(-/iy«o + {-h)p>v } = -supF (4.52) 

that is the supremum of F exists and can be shown as 

sn^F = ~[(-fi)p l v + (-f 2 )p 3 v ] (4.53) 

and 



MF 



supF = (-fi)p l v Q + (-f 2 )p 3 v 



(4.54) 



Then the claim above is satisfied. To show analysis above clearly, a graph is 
given as follows. 

In Fig. 14.91 vq = 1, p = 1.5, /i = —0.4 and fa = 0.3, based on the definition 
of F and Fr] > ^^-v® which is equivalent to 



* i -el ^ P + * 

tip v + hP v o > —^ — v 
2p 



(4.55) 



there exist i,j such that (I4.55[) is satisfied, such as i and j chosen as 2 and 10 
respectively. Also, i and j, which satisfy (I4.50p . exist. If there exist i,j € Z>q 
such that 

(4.56) 



OAp^vo + 0.3p 3 v = ^—v 



2p 




Fig. 4.9 Existence of the infimum of F. 
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then i and j, which satisfy (J4.50I) . exist and the infimum of F is equal to 
^-vq. Otherwise, i and j are chosen such that — 0Ap l v o + 0.3p>vo is larger 

than and closed to ^-vq. In this case, the optimal i and j can be chosen 

as 8 and 7 respectively and the infimum of F is 0.8543 approximately. Then 
select F q = w£F = 0.8543 > 0, we have 

a = sup^sup^,)^ a(x(k)) 

Q(F q ) 






- x 0.8543- ^r^- x 0.8543 



w 0.8252 
where d — —0.5 and Q{F q ) =vq = 1 based on 

0+1 + 1 , 

^— vo < F q = 0.8543 < ^- Vo (4.58) 

Above all, the supremum of multiplier a(x(k)) can be given as 

Q(F q ) 



sup, sup x(fc)e ^ *(*(*)) = T^^^I ^ (4-59) 



where 



F q = MF = inf {Fr)\rj € Z„ = i^.ie Z>o,^ > w = ^v } (4.60) 

Note that if F q < 0, it is easy to see that a is equal to a defined in (I4.59[) . 

Remark 4-6- In the above, all of analysis are based on two-dimensional sys- 
tem, as to n-dimensional system, the analysis process is the same as above 
but more complex than it. The results according to two-dimensional system 
are satisfied for n-dimensional system. 

4-3.5 Expression of Multiplier 

The multiplier a(x(k)) is given as (|4.11[) . If 

f if 0<5< i 
d<g(S) = \ _ 2=M _ /, ! ," (4.61) 

then a(x(k)) is well-defined and satisfies 

< a(x(k)) < a Vx(fc) € i?" (4.62) 
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where 

Q{Fq) (4.63) 



Ifi+Uijr,- 4=1 || F, ||! -dQ(J- g ) 



4p - 1 9 4p 

and 

F 9 = inf F = inf {Fry|?7 6 Z, = ±p*« , iEZ> ,F V >v= ^-v } (4.64) 



4-3.6 A Useful Lemma 



Definition 4.7. [146] Let a class of function be denned by 

S(K 1 ,K 2 ) = {a:R^R\K 1 <^-<K 2 \ (4.65) 

1 V 

A function is said to be of the sector type with sector bounds K\ < K 2 if 
4> G S(Ki, K 2 ). If equality is allowed in either side, the notations S[K 1: K 2 ), 
S(Ki,K 2 ], and S[Ki,K 2 ] are used. 

Definition 4.8. 146 [71] Let A have eigenvalues inside the open unit circle 
and let if be a constant. Define the transfer matrix 

W(z) = -i- = C(zI-A)- 1 B. (4.66) 

K 

We say that W(z) is DPR (discrete positive real) if 

&{ff(e 3U )}>-i Vuei (4.67) 

K 

Lemma 4.9. [1^61 Let L\ be a stable discrete-time system represented by 

x(k + 1) = Ax(k) + Bu(k) 

y(k) = Fx(k) + Du(k) ( 0S> 

Let a : R n — » R be a mapping such that there exists a finite constant a sat- 
isfying < a(x) < a for all x £ R n . Let J\f : R — > R be a sector nonlinearity 
TV G 5[0, n\. Assume that a unique solution to the above system exists when 
u{k) = —Af[a(x(k))y(k)]. Then, if the transfer matrix 

H{z) = F(zI- Ay 1 B + D + ^ (4.69) 

K 
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is DPR, and an < K , the closed-loop system formed by applying the feedback 
u(k) = — Af[a(x(k))y(k)] is stable in the large. 

4.3.7 Stability Theorem for QIQM Systems 

Theorem 4.10. Let a linear time-invariant system under quantized feedback 
with QIQM described by 

x(k + 1) = Ax(k) + Bu(k) 

u(k) = -Q(FQ(x(k))). ^■ m > 

Suppose A has eigenvalues inside the open unit circle. Define the transfer 
function 

G{z)^F{zI~A)- 1 B (4.71) 

Then, the closed-loop system is globally asymptotically stable about origin if 

inf Re{G(e ju )} > e (4.72) 

where 

\\F q \\. 



w- 



-l)}8+l)i(Qik) "^OTFj) i f° <5 ^h 



&s-i}s . 1 ( ^^_ S \\M±) if 1 <s<l (4J3) 

(1-5)2(1 + 5) + (S-l)(S+iy\Q(F q ) °Q(F q )> l J 2 - ° ^ 1 ' 



Proof: The outline of the proof is similar to that of Richter and Misawa 
(2003). We focus on the difference in the following, but also refer to some 
parts of the proof of Richter and Misawa (2003) in order to make the proof 
in a self-contained form. 

At first, change system (|4.70[) to the equivalent form 

x(k + l) = Ax(k) + Bu{k) 

y(k)=Fx(k)+du{k) (4.74) 

u{k) = -Q(a(x(k))y(k)) 

where a(x(k)) is defined in (J4.11I) and the state of this system is identical 
to that of original system based on Lemma 14.21 A unique solution sequence 
exists for every initial condition. Assume a suitable d is selected to guarantee 
that a{x(k)) is nonnegative and upper-bounded by a. Note that quantizer in 
(|4.2p is a nonlinear function with Q £ 5(0, —y[], that is, n — — ^-. Based on 
Lemma 14.91 global stability is obtained if the transfer function 

H(z) = F(zl- A)- 1 B + d+-L (4.75) 

K 
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is DPR with -q^a < K, that is 

Re{G{e 3UJ )}>-d-L (4.76) 

for all frequencies 10. The maximum of K can be chosen as 

Kmax = -d-miRe{G(e^)} (4 ' 77) 

and the following inequation must be satisfied 

K max > -^-a (4.78) 

p + 1 

where a defined in (J4.63I) . Then (|4.78j) is equal to 

d > - ^- + l l|Fgl11 - 1±* miReW(e^)} (4 79) 

> <5(<5 2 - 1) Q(F q ) + 1 - P Q(Fg ) 5 mt ^ e ^ e ^ ^ ' y J 

It is obvious that K max is positive based on inf wG i{ itejG^e- 7 ")} < and d < 
0. Take Condition 1 into consideration, the following inequation is obtained: 

S(S 2 -1) Q(F q ) + IS 2 Q(F q ) 8 11" -fin^^ )S 

( if < £ < ± (4.80) 

<d< {^ if ^<^<l 

Then (|4.72[) is given. Based on Lemma 1431 stability of closed-loop system is 
satisfied. As for asymptotic stability, AV(x(k)) is given as |146j 

AV(x(k)) = -[L T x(k) - WQ(a(x(k))y)] T [L T x(k) - WQ{a(x(k))y)} 
-2Q(a(x(k))y)[y - Q HfW ] 

(4.81) 
where P, L, W satisfies 

A T PA -P= -LL T 

B T PA = F- W T L T (4.82) 

W T W = 2D + f - B T PB 

The first term and second term of (I4.81|) have to be zero for AV(x(k)) to be 
zero. It can be seen that the second term is zero if and only if Q(a(x(k))y) = 
or y — 0. Then the first term of (|4.81[) is changed to —x T (k)LL T x(k). 

Note that Q(a(x(k))y) — is equal to \FQ(x(k))\ < v based on 
Q(a(x(k))y) = Q{FQ{x(k))), and y = Fx(k)-dQ(FQ(k)) = only happens 
in A 6 Qq, where fi$ — {x(k)\Q(x(k)) = 0}, we have 
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= {x\AV(x(k)) =0} 

= [{x\\FQ(x(k))\ <v}{J{x\Q(x(k))=Q}]f)null(LL T )} 
= {x\\FQ(x(k))\ < v}f]nuU(LL T ) 



(4.83) 



where null(LL T ) — {x \x T LL T x — 0}. It is obvious that no information is 
available about null(LL T ), therefore, the left set is taken into consideration. 
Let i? be an arbitrary bounded region of state-space, in which AV(x(k)) < 
0. It can be seen that is the largest invariant set in fi, therefore, the 
trajectories of system must stay within O. Note that system equation in O is 



x(k + 1) = Ax(k) 



(4.84) 



Then the trajectories of system must converge asymptotically to the origin 
based on the eigenvalues of A are inside the open unit circle. Also, the globally 
asymptotic stability is proved according to the arbitrarily large of Q. 



4.4 Numerical Example 

Example J^.ll. In this example, we consider an application of the method 
proposed in this chapter to system (|4.ip . where 



.4 



4 



B 



(4.85) 



It is obvious that A has eigenvalues inside the unit circle, therefore 
Theorem 14.101 can be applied. Select vq — 1, p = 1.5, f\ = —0.4 and 
ji = 0.3 as above, let xo — [38 40] T , we have i = 8,j — 7, F q — 0.8543 
and Q(F q ) = v = 1, then 5 = 0.2 and e sw -0.5933, the graph of G(e jw ) and 
state trajectories of system can be shown as 




-1.5 -1 -0.5 0.5 1 1.5 2 2.5 



Re(G(e lw )) 
Fig. 4.10 Nyquist curve of QIQM system. 
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(>!> 




Fig. 4.11 Limit Cycle of QIQM system. 



The top figure shows stability condition being violated and resulting in 
limit cycle. If F = [-0.4 - 0.4], we have F g = -1.2, e « -1.25 and Q{F q ) = 
—vq = — 1. The Nyquist curve and state trajectories of system can be shown 
as Fig. |4~121 and Fig. I^T51 




Re(G(e lw )) 
Fig. 4.12 Nyquist curve of QIQM system. 



It is obvious that the sufficient condition in Theorem 14. 101 is not satisfied 
and a state trajectory shown as limit cycle and the other converge to a nonzero 
equilibrium. If F = [0.2 0.2], then F q = 0.9, £ « -0.6250 and the states of 
the system asymptotically convergence to zero. 
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Fig. 4.13 State trajectories of QIQM system. 




Re(G(e iw )) 
Fig. 4.14 Nyquist curve of QIQM system. 



Fig. 4.15 Asymptotic stability of QIQM system. 
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4.5 Summary 

Asymptotic stability of QIQM system is analyzed in this chapter. In the pro- 
cess of analysis, a multiplier, which is well-defined, nonnegativc and bounded, 
plays an important role. The stability analysis of QIQM system is transferred 
into the one of an equivalent system by the multiplier. A sufficient condition 
is given for asymptotic stability of QIQM system. Note that the open-closed 
system considered in this chapter is restrict to be stable, that is, the system 
matrix A has eigenvalues inside the unit circle. As to unstable open-closed 
system, the stability analysis of closed-loop system is more challenging and 
will be considered in future. 



Part II 
Data Fusion over Networks 



Chapter 5 

Data Fusion over Networks with 

Measurement Delay 



5.1 Introduction 

Data fusion, one of the key technologies of NCSs, has been served as an inter- 
esting benchmark in the past decades. The fusion center deals with the infor- 
mation from the local sensors to improve the performance of the system. It 
has been applied in both military and nonmilitary fields. Military applications 
include: automated target recognition, guidance for autonomous vehicles, re- 
mote sensing, battlefield surveillance, and automated threat recognition sys- 
tems, such as identification-friend-foe-neutral (IFFN) systems. Nonmilitary 
applications include: monitoring of manufacturing processes, condition-based 
maintenance of complex machinery, robotics, and medical applications. 

The popularization of network technology promotes the development of the 
data fusion. It can implement remote transmission and real-time monitoring 
and so on. However, because of the property of the network, it also exist some 
challenges such as data transmission delay and loss. A significant work is to 
model the arrival process and then to find an optimal algorithm to update 
the current estimate through the delayed measurements. 

The measurement arrival process is modeled as different forms and the re- 
lationship between the process and the stability is studied in many researches. 
|169| addresses Kalman filtering with i.i.d. Bernoulli losses and shows that 
depending on the eigenvalues of the state matrix and the structure of the 
observation matrix, there exists a critical value A c which is related to the 
stability. Meanwhile, |169| gives explicit upper and lower bounds on A c , and 



shows that they are tight in some special cases. [209] proposes a sufficient sta- 
bility condition for time- varying Kalman filter with finite consecutive packet 
losses driven by a Markovian chain. [5T] introduces the notion of peak co- 
variance and gives the upper envelope of the actual covariance process in an 
unstable scalar model and a sufficient condition for peak covariance stability 



for the general vector model. A related problem has been studied in |140j . 
which further shows the known lower bound on A c is the exact critical prob- 
ability. However, in the above two papers, the number of consecutive packet 
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losses can be infinite, which may not be practical and can lead to conserva- 
tive results. |171j develops a suboptimal jump linear estimator for complexity 
reduction in computing the corrector gain using finite loss history where the 
loss process is modeled by a two-state Markovian chain. [45] considers the 
state estimation with lost measurements resulting from time- varying channel 
conditions and introduces a more general multiple state Markovian chain to 
model the loss and non-loss channel states, and the asymptotic mean squares 
estimation error for a suboptimal linear estimator is analyzed and optimized 
by a LMI approach. [37] shows that the expected (with respect to the fading 
process) estimation error covariance at the fusion center remains bounded and 
converges to a steady state value and provides exact deterministic bounding 
sequences on the average error covariance for the system models with scalar 
measurements (per sensor) and specific fading distributions. 

Recently, many researches on state estimation both in centralized and in 
distributed architectures with intermittent measurements have been carried 

out, such as in ma HHH HM D23 E3 HM1 BO EM ES3 [US H53 HSU • EH 

presents an optimal algorithm for updating with out-of-sequence measure- 
ments, however, the method is referring to one-step-lag measurements. [206 
presents a practical architecture and some algorithms for the networked data 
fusion systems with packet losses and variable delays. It's main contribution 
is proposing an optimal solution for one-step and multi-step out-of-sequence 
measurements (OOSM) problem and proving it's stability. However, the as- 
sumption that all the measurements for the different Local Filters are com- 
pressed in the same packets is not realistic. |123] shows the impact of the 
stochastic communication noise on the estimation process and proves that in 
order to maximize the stability range, the receiver should keep all the pack- 
ets independent of the quality of the link or availability of a cross-layer path. 
|13j presents two streamlined algorithms. One is IFAsyn which is optimal for 
the linear system and avoids to recalculate the information of the already 
received measurements, the other is EIFAsyn which is suboptimal solution 
for nonlinear systems. [8] also considers the optimal update algorithm with 
single one-step-lag OOSM, which is called "algorithm A" , and the optimal 
update algorithm, which arc called algorithm All and algorithm BZ1. [164] 
extends the optimal update algorithm with single one-step-lag and Z-step-lag 
OOSMs algorithms in [5] to some optimal centralized update algorithms with 
multiple asynchronous (different lag time) OOSMs. Based on [164j . [163] fur- 
ther presents the optimal distributed fusion update algorithm with multiple 
local asynchronous (1-step-lag) OOSM updates, which is proved, under some 
regularity conditions, to be equivalent to the corresponding optimal central- 
ized update algorithm with all-sensor 1-step-lag OOSMs, and an optimal 
distributed fusion update algorithm with multiple local arbitrary-step-lag 
OOSM updates is also developed. A related problem has been studied by 
[180 , in which the transmission time from each radar to the fusion center 
is assumed to be known only statistically but not exactly, that is, no time 
tag is appended to the measurement. [155] studies optimal estimation design 
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for sampled linear systems where the sensors measurements are transmitted 
to the estimator site via a generic digital communication network. Sensor 
measurements are subject to random delay or might even be completely lost. 
But the assumption in this paper which the arrival process should satisfy, 
is too strict. A parallel work is studied in [166j . in which a probabilistic ap- 
proach of state estimation for two different architectures is developed, and 
the assumption in it is more realistic. 

In this chapter, based on the state estimation algorithm in single channel in 



[166 , we further extends the method to multi-channel, each with a different 
packet arrival statistics. We first model the arrival process via a random 
variable. Then, we propose two different data fusion architectures with finite 
buffer. In the first architecture, we consider the multi-channel system as a 
single one with random variables through a stacked equation, then solve the 
state estimation problem through the Modified Kalman Filter, see Fig. 15.11 
In the second architecture, we combine the Local Filter (LF) and the Master 
Filter (MF) as a data fusion system. The measurements are transmitted 
to the Local Filter with certain data delay probability, then the local state 
estimates are sent to the Master Filter faultlessly to be fused through a fusion 
criteria, see Fig. 15.21 Meanwhile, the stability of the two fusion architectures 
is analyzed straightforward. 

The rest of this chapter is organized as follows: The problem of state es- 
timation with intermittent measurements is formalized in Section 15.21 The 
centralized and distributed fusion architectures and the corresponding fu- 
sion criteria are proposed in Section 15.31 and Section 15.41 In Section 15.51 two 
numerical examples are given to illustrate the effectiveness of the proposed 
algorithms. Finally, Section 15.61 gives the conclusions and directions of the 
future study. 



5.2 Description of Multi-sensors 

Consider the following discrete time linear stochastic system with local 
sensors: 

x(k + 1) = Ax(k) + w(k) (5.1) 

y i (k) = C i x(k)+v i (k), i = 1,2, ...,7V (5.2) 

where N is the total local sensors number, x(k) £ R n is the state vector, 
Di(k) € R mi ,i = 1,2, ...,N, are measurements, w(k) € R" is the input noise, 
and Vi(k) € R mi , i — 1,2, ..., N, are measurement noises, and A, Ci are system 
matrices with compatible dimensions. 

Assumption 5.1. w{k), v(k), k — 1,2,..., A, are the uncorrelated white 
noises with zero mean and 
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E{w(k)w(j) T } = Q(k)S kj 
E{v(k)v(jf} = R{k)6 kj 
E{w(k)v(j) T } = 

where E{-} is the expectation, Q(k) > and R(k) > are covariances 
respectively. 



hj = 



1 if k = j, 

if k / j . 



Assumption 5.2. The initial state x(0) is independent of w{k), Vi(k), i 
1,2,..., N, and 

E{x(0)} = /i(0) 

E{[x(o)-Ko)Mo)-m] T } = P(o) 

Assumption 5.3. (A, Cj) is observable, (A, Q 1 ^ 2 ) is controllable. 
The stacked equation is defined as 



y(k) = Cx(k) + v(k) (5.3) 



where 



T iT 



y(k) = [ ( yi (k)) T , (y 2 (k)) T , ... , (y N (k)) 

O — [ O x j 2 , ... , O^r J 

«(fc) = [ ( Vl (k)) T , ( V2 (k)f , ... , (Mfc)) T ] T 

There are two forms of sending information to the Fusion Center (FC). One 
is that the measurements of local sensors are time-stamped and transmitted 
through network to the Fusion Center directly. The other is that the mea- 
surements are sent to the Local Filters, then the state estimates of the Local 
Filters are delivered to the Master Filter. Time-stamping is necessary to re- 
order measurements at the filter as they can arrive out of sequence or even 
be lost due to the unreliability of the transmission through network. For the 
model in this chapter, each yi{k) is delayed by di(k) times, where di(k) is a 
random variable described by a probability mass function ff. 

fiU)=Pr[di(k)=j], j = 0,1,2,... ,i = l,2,...,N (5.4) 

For simplicity, we assume that fi ± and fi 2 are independent and identical 
distribution (i.i.d) if i\^%i, and d(k\) and d(k-i) are independent if k\^=-k<i- 
We further assume that di{k) is independent of w(k), Vi(k) and the initial 
state x(0). 

In this chapter, similar to [166 , we assume that all observation packets 
correctly delivered to the Fusion Center are stored in a buffer with length 
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of L. If yi(k — L) is not received by the FC before or at k, then it will be 
considered to be lost, the arrival process is modeled via the random variable 
7i(t,fc): 

, , . _ J 1 if Di(t) arrived before or at time k,k > t , , 

7U*,«;-| otherwise . y b - b > 

From this definition, it follows that if ji(t, k) = 1, then ji(t, k + I) = 1 for 
VZ <G N, which indicates that if j/»(£) is received by the filter before or at time 
k, then it will be present for all future times. More formally, the value stored 
in the i-slot of the buffer at time k can be written as 

yi(t, k) = 7i (f, k)yi{t) = 7i(*, k)Cix(t) + 7i(*, fc)vi(i) (5.6) 

The optimal update problem is as follows: 

x(fc|fc)=£{x(fc)|y fc , 7fe } (5.7) 

5(fc|fc-l) = B{x(fc)|yfc_i,7fc-i} (5-8) 

where 

Y k = [y(l,k),y(2,k),...,y(k,k)} 

y{t, k) = [( yi (t, fc)) T , (y 2 (i, fc)) T , ..., (y N (t, k)f] T 
7fc = [7(l,fc),7(2,fc),...,7(fc,fc)] 

7(i,fc) = [71 (t, fc),7 2 (i,fc),...,7Ar(i,fc)] T 

Without loss of generality, the error and error covariance are defined as 

e{k\k) = x{k) - x{k\k) (5.9) 

P(k\k) = E{e(k\k)(e(k\k)f\Y k , lk } (5.10) 

e(k\k - 1) = x(k) - x(k\k - 1) (5.11) 

P(fc|fc - 1) = E{e(k\k - l)(e(k\k - l)) T |77,-i,7fc-i} (5-12) 

For convenience, we define the following variables: 

x(t\h,k) = E{x(t)\y(l,k),y(2,k),...,y(h,k),-r(l,k)^(2,k),...^(h,k)} 
e(t\h,k) = x(t) -x(t\h,k) 

P(t\h, k) = E{e(t\h, k)(e(t\h, k)) T \y(l, k), y(2, fc), ..., y(/», fc), 
7(l,fc),7(2,fc),...,7(fe,fc)} 

Obviously, x(fc|fc) = x(fc|fc, k) and P(fc|fc) = P(fc|fc, fc) . 

In the following, two different architectures and methods of computing the 
optimal estimate and the error covariance by utilizing the delayed observa- 
tions will be considered. 
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5.3 A Centralized Fusion Method of Multi-channel 
Estimation with Measurement Delay 

In this part, we assume that all the measurements are sent to the Fusion Cen- 
ter directly through the communication channels, then a centralized method 
of computing the optimal estimate and the error covariance by using all the 
information including the delayed observation will be presented. 




Fig. 5.1 Centralized fusion system. 
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Similar to (|5.3[) , the observation equation can be written as 
y (t,k) = C(t,k)x(t)+v(t,k) 



where 



y(t,k) 



v(t,k) 



fyi(t,k)\ 

V2(t,k) 



>C(t,k) = 



\y N (t,k)J 

( lx (t,k)vi(t,k) \ 

72(t,k)V2(t,k) 



/ 7 i(*,*0Ci \ 

!2{t,k)C 2 

\ lN {t,k)C N ) 



\7jv(*, k)v N (t, k) J 
and the covariance of the vector v(t, k) is given as 



R(t, k) = E{v(t, k)(v(t, k)) T } = 



Ri 

R 2 



• • • R N 



(5.13) 



(5.14) 
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where 

Ri = 



R% 


if 


Ji(t,k) = 


= 1 


a 2 I 


if 


Ji(t,k) = 


= 



In reality, the absence of observation corresponds to the limiting case of 
it — * oo , i.e., the measurement noise can be seen as infinite if the observation 
is not received, see [169] , 

The length of the buffer in multi-channel will be described as 

L= ( max{Li\ if 3U s.t. Pr[Pi(k\k)(Li, f t ) < M] > 1 - e} , g _ 

1 oo otherwise 

where Li is the length of the given buffer in single channel and the computa- 
tion of it can be seen in |166| . /, was defined in (|5.4|) and Pr[Pj(fc|fc)(Lj, fi) < 
M) is the probability of Pi(k\k) < M under the condition of £»,/>. The 
received measurements are stored in the buffer which the length is L, i.e., 
y(t,k) = [{ yi (t,k)) T ,(y 2 (t,k)) T ,...,{y N (t,k)) T ] T , t = k-L + l,...,k, are 
stored in the i-slot of the buffer at time k, meanwhile, if the measurement 
yi(t, k), t = k — L + 1, ..., k, % = 1, 2, ..., N has not been received until time 
k, then the dummy variable zero would be stored in the corresponding slot. 

N N 

min{t\ J2 7i(*) k ) > J2 7»(*) k),k - L + I < t < k} , , 

k otherwise 

From the definition of r, it can be seen that y(r, k) is the oldest measurement 
vector, in which at least one measurement j/j(t, k) is received by the FC at 
time k. 

Now we can give the main results of this section: 



Theorem 5.1. Consider the stochastic linear system given in equations 15. 1\) 
- \5.2\) . the optimal estimate x{k\k,k) can be computed as follows: 

(1) when 1 < k < L , we have: 

x(t\t-l,k) = Ax(t-l\t-l,k) (5.17) 

P(t\t - 1, k) = AP(t - l\t - 1, k)A T + Q (5.18) 

K(t, k) = P{t\t - 1, k)C(t, k) T (C{t, k)P(t\t - 1, k)C(t, kf + R(t, k))- 1 

(5.19) 
x(t\t, k) = x(t\t - 1, k) + K(t, k)(y(t, k) - C(t, k)x(t\t - 1, k)) (5.20) 
P(t\t, k) = (I- K(t, k)C(t, k))P{t\t - 1, k) (5.21) 

for t = 1,2,..., k and £(0|0, k) = a;(0) , P(0|0, k) = P(0) . 
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(2) when k > L , from the definition of t, we have: 

x(t - 1|t - 1, k) = x(r - l|r - l,k - 1) (5.22) 

P(t - 1|t - 1, k) = P(t - l|r - 1, k - 1) (5.23) 

then as equations ^5.17\ )- (5.21\) . for t = r, ...,k, the optimal estimate x(k\k) 
and the error covariance P(k\k) can be easily obtained by iterating k — r + 1 
times from x(t — l|r — 1, k). 

Proof: 

(1) Substituting y(t,k), C(t,k), v(t,k) and R(t,k) into the standard 
Kalman filter, then (|5.17p - (|5.2ip can be gotten. 

(2) From the definition of r in equation (|5.16p . it can be known: r is 
the oldest time when the measurement of one communication channel was 
updated, i.e., no new information in observation vector y(t),t = k — L + 
1, ..., r— 1 in equation (|5.3|) was received at time fc, therefore, x(t— 1|t— 1, k) = 
x(T-l\r-l,k-l), andP(r-l|r-l, k) = P{r- 1|t- 1, k- 1), the optimal 
estimate x{k\k) and error covariance P{k\k) can be obtained by iterating 
k — t + 1 times from x(t — l|r — 1, k). 

Remark 5.2. If there is no observation delay or loss, i.e., 7i(i, k) = 1 for 
Vi < k and \/i = 1, 2, ..., N, then the method in Theorem 15. II can be seen as 
the standard Kalman Filter. If there is only one communication channel, i.e., 
N = 1, then the method is similar to the Modified Kalman Filter in 169J 
and fTMl. 



Remark 5.3. [154] also presented a method of state estimation with buffer, 
but the assumption x(k — L + l\k — L + 1, k) = x(k — L + l\k — L + 1, k — 
1), P(k -L + l\k-L+l,k) = P{k - L + l\k - L + l,fc - 1) is unrealistic. 
Compared with [154] . there is no such constraint on the arrival process, so the 
method in this chapter is not necessary to iterate L times from the beginning 
of the buffer, but just k — r + 1 times from r — l(fc — L + 1 < t < k) when 
one new measurement j/*(t, k) is received by the FC at time k. In particular, 



ifr = fc — L + 1, then the method of Theorem 15. II is similar to that of [154] 
i.e., the result in [154] is a special case of this chapter. 



Note that the data fusion method with buffer in Theorem 15.11 always includes 
more information than that without buffer, then another result can be given 
as follows: 



Theorem 5.4. Consider the stochastic linear system given in equations 15. 1\) - 
115.2]) . and the data arrival process in equation 115.5]) . Let the optimal estimate 
x(k\k) computed by Theorem \5.1\ with buffer be x(k\k, k), and without buffer be 
x\k\k) ifP(k\k, k) = E{(x(k) - x(k\k, k))(x(k) - x(k\k, k)) T }, and P(k\k) = 
E{(x(k) - x(k\k))(x(k) - x(k\k)) T }, then 

P{k\k,k) < P{k\k) (5.24) 
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Proof: According to the computation of x(k\k, k) — E{x(k)\Yk, 7fc}, we know 
that Y/c includes both the measurements arrived on time and that delayed not 
more than L— 1 times. Meanwhile, x(k\k) = E{x(k)\Yk, jk}, Yk only includes 
the measurements arrived on time. Obviously, Yk contains more information 
than Yk, i.e., Yk 2 Yk- Therefore, the error covariance of x(k\k, k) with buffer 
is always smaller than that of x(k\k). 

5.4 A Distributed Fusion Method of Multi-channel 
with Measurement Delay 

In this section, we assume that all the measurements are sent to the local 
fusion filter through the communication channels, then the local optimal 
estimates are delivered to the Fusion Center directly. We also assume that 
the Fusion Center received the optimal estimates without data loss or delay, 
then based on |166| , in which a single channel optimal estimate method was 
proposed, a distributed fusion theorem of computing the optimal estimate 
and the error covariance by using all the information including the delayed 
observation will be presented. 
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Fig. 5.2 Distributed fusion system. 



First, we will introduce a well-known distributed fusion architecture: Fed- 
erated Filter. In this fusion architecture, the Local Filters sent their state 
estimates to the Master Filter, then the Master Filter fused the estimates 
according to the following criteria to get the global state estimate: 



iV 
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where Xi(k\k) and Pi(k\k) are the state estimate and the error covariance of 
the ith Local Filter, respectively, x g (k\k) and P g (k\k) are the global optimal 
state estimate and its error covariance. 

As aforementioned, for the model in this chapter, each yi(k) is delayed by 
di(k) times, where di(k) is a random variable described by a probability mass 
function /,: 

Mj) = Pr[d z (k) = j], j = 0,1,2,..., i = l,2,...,N 

where fi t and fi 2 are independent and identical distribution (i.i.d) if ii^i2, 
and d{k\) and <i(fe) are independent if k^k^. 

Based on the single channel fusion method in |166) . it is easy to find a 
sufficient and necessary Li such that E{Pi(k\k)} is stable, i.e., E{Pi(k\k)} < 
M. We also define 

min{t\ if 3 t s.t. Ji(t, k) = 1 and "fi(t, k — 1) = 0, 

0< k-Li + l< t< k}, (5.25) 

k otherwise. 

for the ith channel. 

Then the global state estimate can be computed as follows: 

Theorem 5.5. Consider the stochastic linear system given in equations \5.1\) - 
i5.ty) , and the data arrival process in equation \5.5\) , the optimal estimate 
x(k\k, k) can be yielded by two steps: 

Step 1: Computing the state estimate and the corresponding error covariance 
of the ith Local Filter as in [1661: 

Xi{n - l\n - 1, k) = Xi(n - l\n — l,k — i) (5.26) 

Pi{n - i\n - 1, k) = P^n - l\ n - 1, k - 1) (5.27) 

Ki( n ,k) = ^{nln - i,fe)Cf (CiPiinln - l,k)Cj + R,)- 1 

(5.28) 
Xi{n\Ti, k) = Axi{Ti[Tu k) + 7i(rj, k)K l (T il k){y. l (T. l ) - C l x i (T i \T i , k)) 

(5.29) 

Pi(Ti\Ti,k) = {I-'Yi(Ti,k)K i {Ti,k)Ci)P i {Ti\Ti - l,fc) (5.30) 

where £(0|0, k) = a;(0), P(0|0, k) = P(0). 

Then the optimal estimate Xi(k\k) and the corresponding error covariance 
Pi(k\k) can be yielded by iterating k — t times from x(t\t, k). 

Step 2: After receiving the state estimates from the Local Filters, the global 
estimate can be obtained according to the Federated Filter criteria as 

N 

p 9 (k\k) = lY^iPmr 1 }- 1 (5.31) 
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N 



7 (k\k) = P g {k\k) X)( p »(*l*)) _1 *i(*l*) ( 5 - 32 ) 



i=l 

Proof: The proof is similar to the proof of Theorem 15.11 

Theorem 5.6. Consider the stochastic linear system given in equations H5.1]) - 
(5.ty) , and the data arrival process in equation J5.5]) , the sufficient and nec- 
essary minimum Li, i = 1, 2, ..., N, can be always found such that: 

Pg{k\k) < M 

Proof: For the ith (i — 1,2, ...,N) Local Filter, 166 has proved that there 
must be sufficient and necessary minimum Li, i — 1,2, ..., N, such that 
Pi(k\k) < M, and it is obvious that P g (k\k) < Pi(k\k) according to 
equation (I5.31|) . therefore, we have P g {k\k) < M. 



5.5 Numerical Examples 

In this section, we illustrate some examples of different parameters to support 
the results in this chapter. 

Consider the following discrete time linear stochastic system with local 
sensors in equation (|5.1|) and equation ([57 



A= q im , C 1 = [ll], C 2 = [11.5], 
Q = q , , #1 = 1) R2 = 1-5, 

Similar to [166j . we model the packet delay as a Poisson distribution with 
mean di, i.e., the probability density function satisfies: 

m = { ^—, j = 0,1,... 

where di = E{d l k } denotes the mean value of the packet delay in the ith. 
channel, and in this chapter suppose d\ = 3 and c?2 = 2. 

5.5.1 A Centralized Example 

In this example, from the centralized filter architecture, we can obtain corre- 



sponding D\ = 5 and D2 = 3 by utilizing the same method as shown in [166j 
such that single channel keep stable. Then we choose D = max{D\, D2] = 5 
to illustrate Theorem I5.1l as shown in Fig. !5.31 Fig. 15.51 



N(i 
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Fig. 5.3 The trace of the covariance of filter with buffer=5 and without buffer in 
centralized system. 



- The trace of covariance with butter-5 

- The trace of covariance with buffer-3 




Fig. 5.4 The trace of the covariance of filter with buffer=5 and buffer=3 in cen- 
tralized system. 



- The trace of covariance with buffer-5 

- The trace of covariance with buffer-6 




400 420 



Fig. 5.5 The trace of the covariance of filter with buffer=5 and buffer=6 in cen- 
tralized system. 
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From Fig. 15.11 it is clear that the trace of the error covariance with buffer 
D = 5 is much smaller than that without buffer. However, if D = 3 as 
shown in Fig. 15.21 the performance of the filter become worse than D = 5. 
Meanwhile, from Fig. 15. 31 we also notice that D — 6 leads to little difference 
on the filter, but increases burden of calculations. 



5.5.2 A Distributed Example 



In this example, a distributed filter architecture is considered and we also 
choose D\ = 5 and D2 = 3 to estimate the Local Filters states, then send 
them to Master Filter. Fig. 15.61 and Fig. 15.71 show the simulation results as 
follows: 




Fig. 5.6 The trace of the covariance of filter with buffer=5 and without buffer in 
distributed system. 



The trace of LF1's covariance 

- The trace of LF2's covariance 

- The trace of MF's covariance 




Fig. 5.7 The trace of the covariance of the Local Filters and the Master Filter 
with buffer=5 in distributed system. 
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From Fig. 15. 61 and Fig. 15.71 we can see that the trace of the error covariancc 
of the Master Filter is smaller than that of local filters and that without 
buffer. 

Actually, there have been proved that under the assumption of cross- 
uncorrelated sensor noises, the centralized Kalman Filter is equivalent to 
the distributed Kalman Filter when all the measurements information are 
received. 



5.6 Summary 

In this chapter, we have presented two different architectures for networked 
data fusion-a centralized architecture and a distributed architecture with 
finite buffer. It is shown that the performance of the fusion filter with buffer 
is much better than that without it. The results obtained are useful for the 
practical applications. Finally, two numerical examples are given to show the 
theorem proposed in this chapter. An important future study is to consider 
the relationship between the local sensors, it is interesting to extend the work 
in this chapter to that aspect. 



Chapter 6 

Networked Data Fusion with the 
Asynchronous Observations at 
Multiple Rates 



6.1 Introduction 

Most of the earlier works are based on the measurements observed by sen- 
sors with synchronous samples at the same sampling rate 10, 20, 23, 28, 39 . 
Only a few pieces of work deal with asynchronous multirate multisensor data 
fusion. Based on continuous time systems, Alouani with his group 4J and 
Bar-Shalom et al. [10, 8] present some effective algorithms for asynchronous 
multisensor systems. As far as the discrete time systems are concerned, the 
related researches include the approaches based on multiscale system the- 
ory [H [TQ HI [Ml CUD EH>], the batch process methods [EH], and the 
algorithms based on the designing of multirate filter banks |32], etc. In the 
literature listed above, the missing of observations is rarely concerned, which 
is inclined to encounter in many application fields including communication, 
navigation, etc. For filtering of incomplete measurements, there are some in- 
teresting results. Among these, the algorithms presented by the team of Wang 
are promising that it has proper computation complexity and can generate 
nearly optimal state estimate [194] . Based on a discrete-time linear dynamic 
system, Kalman filtering with intermittent observations is studied in [169j . 
where the arrival of the observations is modeled as a random process, and 
the statistical convergence property of Kalman filter is given. The modified 
Riccati equation is studied by Boers and his group [T5] . Some useful results 
are presented as far as a single sensor observing a single target which is de- 
scribed by a linear state space model is concerned. Kalman filtering with 



faded measurements is studied in 173 . By use of peak covariance as an 
estimate of filtering deterioration caused by packet losses, the stability of 
Kalman filtering with Markovian packet losses is studied in [ST] based on a 
linear time-invariant system. Bar-Shalom studies the state estimation with 
out of sequence measurements based on a time-invariant dynamic system 
[8j. Xia, Shang, Chen and Liu study the networked data fusion with packet 



losses and variable delays, and an optimal state estimate is generated [206 . 
However, in all these interesting papers, multirate systems are not concerned. 

Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 89- |l05.| 
springerlink.com © Springer- Verlag Berlin Heidelberg 2011 
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The multi-rate linear minimum mean squared error state estimation problem 
is solved by use of the lifting technique [55] . While, asynchronous sampling 
and data losses are not concerned in this reference. To sum up, there are few 
results on the fusion of multirate sensors that sample asynchronously with 
measurements randomly missing. This motivates us for the present study. 

In this chapter, the optimal state estimation for a kind of linear dynamic 
systems with the observations obtained asynchronously with multiple rates 
will be concerned, where the observations may lose randomly. For each sensor, 
a rule is proposed to check out whether the measurement is missing. With 
the help of the modified Kalman filter, the multiscale system theory and the 
federated square root filter, the optimal state estimate is obtained at the 
highest sampling rate. 

This chapter is organized as follows: Section r6.2l is the problem formulation. 
In Section 16.31 the state estimation algorithm is presented. Section 16.41 is the 
numerical simulation and Section 16.51 reaches the conclusion. 



6.2 Description of Multi-sensors with Different 
Sampling Rates 

A class of dynamic system that is observed by multiple sensors will be con- 
sidered in this chapter. These sensors sample asynchronously at different 
sampling rates with measurements randomly missing |2111 11041 11941 1103] 

x{k + 1) = Ax(k) + w(k) (6.1) 

Vi{k) = ii(k)CiXi(k) + Vi(k), i = 1, 2, ..., A^ (6.2) 

where x(k) £ R n is the state variable vector at time kT, where T is the 
sampling interval of sensor N. A £ R n * n j s the system matrix. The process 
noise w(k) £ R nxl is zero-mean white Gaussian sequence, whose variance 
is Q. 

The system state vector x(k) is observed by N sensors, and each sen- 
sor i observes the same single target independently with different sampling 
rates. The measurements yi(k), i — 1, 2, • • • , N are obtained asynchronously. 
Vi{k) £ R qiXl (qi < n) is the fcth measurement observed by sensor i with 
sampling rate Si. The sampling rates of the sensors meet 

S % = S N /m, l<i<N-l (6.3) 

where rii are known positive integers. For i — 1, 2, • • • , N, Ci £ R<n yn is the 
measurement matrix. The measurement noise Vi(k) £ R qiXl is supposed to 
be a zero-mean white Gaussian noise with variance Ri, i = 1, 2, • • • , N. 

The initial value of the state vector x(0) is a random vector, whose mean 
and estimation error covariance are xo and Pq, respectively. It is assumed 
that a:(0), w(k) and Vi(k) are mutually independent. 
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The variable 7i(fc) G R is a stochastic sequence that takes values on 1 
and with Bernoulli distribution, which is used to describe the missing of 
measurements. It is assumed that Ji(k) is independent of w(k), Vi(k) and 

3(0), t = i,2,..-,j\r. 

The objective of this chapter is to develop an algorithm, which can effec- 
tively fuse the measurements observed by different sensors with asynchronous 
sampling at multiple rates in case of measurements randomly missing, in or- 
der to generate the optimal estimate of state x{k). 

Remark 6.1. The asynchronous multirate multisensor dynamic system is de- 
scribed at different scales, where the sensors that observe the target with 
higher sampling rates are at finer scales, and the sensors that observe with 
lower sampling rates are at lower scales. 

Remark 6.2. For simplification, time delay and out of sequence measurements 
are not concerned in this chapter. The measurements of sensor N are divided 
into blocks, and the length of per block m(ni, 712, • • • , Un—i) is the least 
common multiple of ni,ri2, • • • , and un—i- It is assumed that sensor N (at 
the highest sampling rate) should sample uniformly. While, any other sen- 
sor i(l < i < N — 1) does not need to sample uniformly but should sample 
Pi = m(ni,7i2, • • • ,np{-i)/ni times per block. This means yi(k) can be ob- 
tained at any time between (pi(k — 1) + 1)T and (pik)T, and the sampling of 
different sensors can be asynchronous. For example, in Fig. 16.11 sensor 3 at 
the highest sampling rate samples uniformly, i.e., 2/3 (k) is obtained at time 
kT. As to sensors 2 and 1, whose sampling rates are half and one third of 
sensor 3, respectively, may sample non-uniformly. y<i (k) is obtained at any 
time between (2k — 1)T and (2k)T. y\(k) is obtained between (3fc — 2)T and 
(3fc)T. We refer the readers to |211j or [104j for more detail. 



sensor 
3 



1 



12345 6l 789 10 lldtime (sampling instant) 

Fig. 6.1 Time (sampling instant) vs. sensor. 



6.3 The Data Fusion State Estimation Algorithm 

When there is no any prior information, the state variable vector Xi(k) at 
scale i may be established by the state vector x(riik) at scale N through the 
following linear transformation [TT1 [H Hill l2"2"51 ITUi) : 
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1 «,-i 
{k) = -[Y, A- m ]x{mk) (6.4) 



?n— 



where n, is the sampling ratio of sensor N to sensor i, i = 1, 2, • • • , N. 

In the sequel, we will first establish the state space model at scale i(l < 
i < N). Then, using the modified Kalman filter at scale i to estimate Xi(k). 
Finally, by regressing the estimate from scale i to N, and then by fusing 
them, the optimal state estimate of x{k) will be generated. 

Theorem 6.3. The dynamic system models can be described at scale z(l < 
i < N) by the following formulas: 

x l {k + l) = A l x. l {k)+w l {k) (6.5) 

y i {k)=-n{k)C i x i {k) + v i {k) (6.6) 

where uii{k) and Vi(k) are zero-mean Gaussian white noises that satisfy 

E{wi(k)wf(l)} = QiSu (6.7) 

E{v i (k)vj(l)} = Q i 5 ij S k i (6.8) 

E{ Wi (k)vj(l)} = 0, i,j = 1, 2, • • • , N - 1; k, I = 1, 2, • • • (6.9) 



Ai = A n - (6.10) 



rii — 1 rii — 1 Tii — 1 

Tit 
L m— m=0 7n=0 



1 rij — 1 n j — 1 7i j — 1 

Q< = — E ^ m ][E ^ m Q^ m ' T ][E A- m f (6.11) 



where £'{■} is the expectation function, Ski is the Kronecker 5 function, and 
A m ' T denotes the transpose of A m that is the mth power of matrix A. 

Proof. When i = N, un = 1, we have A^ = A nN = A. Therefore, from (frTTj) 
and (16.21) . we have Theorem 1 in the case of N = 1. Generally speaking, from 
|, we have 



i (fc+f) = -[V nx(«,(Hi)) 

n* * — ' 

771=0 

_. n-i — l 

= — [V A- m }[Ax(nik + ni -l)+w(nik + m- 1)1 (6.12) 

771=0 
1 Tli — 1 Tli — 1 

= — []T A- m ][A ni x(mk) + ]T A m w( ni k + m-l- m)\ 



771=0 771=0 

= AiXi(k) +Wi(k) 
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where 

A, = A ni (6.13) 

and 



_. rii — l rii — 1 

(k) = — [ ]T A- m ] ]T A m w(n t k + m-l-m) (6.14) 



771—0 m— 



For the stochastic sequence u^(fc), by use of the linear property of the math- 
ematical expectation, we have 



1 rii — l rti — l 

E{w t (fc)} = — []T A ~ m ] ]L A m E{w{n l k + n. l ~l-m)} (6.15) 



m— m— 

and 






1 'Hi — L 

E{w t (k)wl(l)} = E[{-lY,A- m } (6.16) 



777=0 



ru-1 



^ A m W (n,;fc + n,-l-m)}{ — [j^ A~ m ] ^ A m W (n,fc + n t - 1 - m)} 2 



m— m=0 7n=0 



= ^tE A ~ m nE ^ m Q^ m ^ T ][E ^~ m ] T ^ ( 6 - 17 ) 

1 m — 771 — 777 — 



where A m,T denotes the transpose of A m , and where 

?ii — 1 ?7i — 1 n^ — 1 



j * VI J- Itj _l_ I l>i _L 

Q t = —[^2 A ~ m ]lJ2 A m QA m > T ][J2 A- m ] T (6.18) 



1 771 = 



In addition, by use of (J6.14D and the independence of w(k) and Vi(k), for 
i,j = 1,2, • • • ,N — 1; fc, / = 1,2, • • •, we have 



_. Tli— 1 77^ — 1 

B{«x(jfc)t;f «)} = £[{ — [V A"" 1 ] V A m W (n l fc + n 4 -l-TO)}wf(/)]=0 

71^ Z — ' Z — ' J 

777 — 777 — 

D 
For i = 1, 2, • • • , N, denote 

£i(k\k) = E{xi(k)\Yf(i)} (6.19) 

x Nli (k\k) = E{x(k)\Y^ ] (i)} (6.20) 

x(k\k) = Eixik^YfiN)^^^ 1 (N - 1), • • • ,Y [ fi (1)} (6.21) 
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where 



r i fe (z) = {y l (l),y 4 (2),..., 2/ . i (fc)} 



(6.22) 



In the sequel, x(k\k) is to be generated. 

It should be noted that Yj°(i) is the first to the /c-th measurements observed 
by sensor i. Xi(k\k) means the expectation (the estimation) of Xi(k) based 
on information from Y± (i). Xffu(k\k) means the expectation of x(k) based 
on the information from sensor i obtained till time kT. x(k\k) means the 
expectation of x{k) based on the information from all the sensors up to time 
kT. '[■}' in (|6.20[) and (|6.21j) means the minimum integer that is not less 
than '■'. 

Based on the results in [20, 169, 30 , we have the following theorem. 

Theorem 6.4. For any k — 1, 2, • • • , the estimate and the estimation error 
covariance of x(k) based on all the observations before time kT are denoted 
by x{k\k) and P(k\k), then they can be generated by use of the following 
formulas: 



A 



x(k\k) = 2J tti(k)x N \i(k\k) 

z=l 

N 

p{k\k) = {Y J p N \ l {k\ k )r 1 



(6.23) 
(6.24) 



where 



ai{k) = P{k\k)P~Uk\k) 



(6.25) 



m-l 



i[J2 A- m ]- l Xi{l\l), ifk = ml 



x N \i(k\k) = < 



m=0 

m-l 



m=0 



.26) 



l AP\Y, A-™]- 1 ^), ifk = ni l+p, p=l,2,---,m-l 



P N[i (k\k) = < 



[£^- m ]- i Pi(jio[i>- m ]- T , 

rn— m— 

rii — 1 rii — 1 

Ap[J2 ^ _m ] _1 ^('IO[^ A- m ]- T A p '' 



if k = nil 



m=0 



p-1 



m= 



(6.27) 



J2 Al QA 



l,T 



1=0 



if k = nil +p, p = 1,2,- • • ,rii - 1 
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and for I = k/rii, 

x(i\D = { £i ^ 1 ~ x) + K ^ y ^ ~ CA ^ 1 - x )]' ify ^ e w) 

1 Xj(Z|i — 1), otherwise 

P ,,, n _ / [/ - ^(oaiPiOii - 1), W) e w, o 

<W; ~\P < (f|i-l), otherwise 

Xi(l\l - 1) = AiXi(l - l\l - 1) 
Pi(l\l - 1) = A 4 p(Z - 1|/ - l)Aj + Qi 

Ki(l) = Pi(i|J - l)Cf [CiPi^ll - l)Cf + Ri]' 1 

w/iere 

y(i, = {w(0H h/<(0 - WW - i)]fe/<(0 - Ci^^ii - i)] T < apj (6.28) 

where A cem/d fee any scalar larger than 4- The initial terms are, 

x,(0|0)=xo, P(0|0)=P (6.29) 

Proof. We will prove this theorem by use of the deduction method. 
For i — N and k = 1, from equation (|6.1|l . it follows that 

£jv(1|0) = Aa;o = Axat(0|0) (6.30) 

therefore, 

ijv(l|0) = x(l) - x jv(1|0) = Arjv(0|0) + tu(O) (6.31) 

and 

Pv(l|0) - P{zjv(1|0)xjv(1|0) t } = APv(0|0)A T + Q = A N P N (0\0)Al + Q N 

If measurement yjv(l) is missing or faulty, then it should be avoided. In this 
case, £Ejv(1|0) does not need to be updated. Then we have 

M1|1)=M1|0), Pv(l|l) = Pv(l|0) (6.32) 

If measurement y./v(l) is normal, then by use of Kalman filter 30 , it results 
in 

xjv(1|1) = xjv(1|0) + K N (l)[y N (l) - C N x N (l\0)} (6.33) 

Pv(l|l) = [I - K N (1)C N ]P N {1\0) (6.34) 

where 

K N (1) = P N (1\0)C%[C N P N (1\0)C% + En]- 1 (6.35) 
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When k = 1, if there are no other observations, then 

x(l\l) = X N (l\l),P(l\l) = P N (l\l) (6.36) 

Otherwise, if there exist j/i(l) and n, = 1, then aij(l|l) and Pj(l|l) can 
be generated in the same way as xjv(1|1) and Pjv(1|1). The fused state 
estimate x(l|l) and the error covariance P(l|l) can be generated by use 
of the federated filter [5D], and (23)-(24) can be obtained. For measure- 
ments j/i(l) with m ^ 1, it is obvious that j/i(l) should be obtained at 
time IT that meets uniform distribution between [1, rii]T. Hence, the event 
"j/i(l) and j/jv(l) arrive at exactly the same time" can be viewed as a small 
probability event. When I £ (l,rij], for simplification and consistency, 2/j(l) 
would not be dealt with until time n{T . 

It should be pointed out that one may use the following rule to judge 
whether measurement j/i(l) is missing or not: 

[y t (l) - dXi(l\l - l)][ yi (l) - CiXi(l\l - 1)] T < XR t (6.37) 

where A could be any scalar larger than 4. The reason is that 

E{[y t {l) - C t x z (l)][y t (l) - C %Xl (l)] T } = R % (6.38) 

Briefly, the theorem is true when k = 1. 

Suppose x(k — l|fc — 1) and P(k — l\k — 1) have been generated by use of 
Theorem 16.41 x(k\k) and P(k\k) will be deduced in the sequel. 

Denote 

y(i, I) = { yi (l)\\ [ yi (l) - QAiXiU - l\l - 1)] 

[ Vi {l) - CiAiXi(l - l\l - 1)] T < XRi] 

Then, 'yi(l) qL y(i, I)' means the Z-th. measurement from Sensor i is missing. 
It follows from (JHISJ) and floTll)|) that 

Xi{l\l) 

_ / ^{^(Ol^- 1 (*)} + Kiil^yiil) - CiEixiWYi- 1 ®}], if W (0 G y(i, I) 
E{ Xi (l)\Yl- l (i)}, else 

Xi(l\l - 1) + Ki(l)[ yi (l) - dxi(l\l - 1)], if yi(l)(=y(i,l) (f ,„ Q , 

Xi(l\l-1), else l j 

therefore, from (I6.5|) . (|6.6p and (|6.39p . we have 

Xi(l\l) = Xi(l) - Xi(l) (6.40) 

[I-Ki^CijXiilll-V + KiWviil), if yi (l)£y(i,l) 
Xi(l\l — 1), else 
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and 

Pi(l\l) = Exi(l\l)xf(l\l) (6.41) 

ni-i^OcyPiW-i), if yi(i)ey(ij) 

\Pi(l\l-l), else 

where Ki(l) is deduced by Kalman filter as follows, 

Ki{l) = Pi(l\l - l)CT[CiP t (l\l - l)Cf + i?,]" 1 (6-42) 

Equation (|6.4[) can be rewritten as 



o;(n i 0=ni[X;i4- m ]- :l Xi(0 



m=0 



therefore, 



£jv|i(ro»JK0 = E{x(nil)\Y{(i)} 
m-i 



m=0 




m-i 




n^A-n 


-^{^(OI^'W} 


m=0 




n«-l 




"itE^-™] 


_1 4<(i|0 



m=0 



From (|6.1|) . for p = 1, 2, • • • , n» — 1, we have 



(6.43) 



(6.44) 



= E{x(riil + p)\Yl(i)} 



p-i 



E{A p x{n t l) + Y^ A p w( ni l +p-l- l)\Yl(i)} 



1=0 



APE{x( ni l)\Y((i)} 



iA p [J2A- 



l Xi(l\l) 



(6.45) 



m— 



Equations (I6.44J) and (|6.45(1 can be rewritten as 
m-i 



X N \i(k\k) = < 



4 [E ^~ m ]~ 1 Si(i|0. if fc = ntJ 

m=0 



.46) 



£i(Z|i), if fc = n»i + p, p = 1, 2, • • ■ ,rii — 1 
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From (J6.21I) . by use of the federated filter, we have 



x{k\k) =£M£0|lf'(AO,n {N-l)X ni W) 



N 



= Y,<k) E {< k )\ Y iW ( 6 - 47 ) 

N 

= ^2ai(h)x N \i(k\k) 



where 



and 



N 



P(k\k) = (X)^|i(*l*)) -1 . «*( fc ) = ^(*l*)^|<(*l*) ( 6 - 48 ) 



P^TO = E{[x(k) ~ x N[l (k\k)}[x(k) - x Nll (k\k)f} (6.49) 

which can be deduced by use of (|6.50p - (l6.53[) . 
For k = ml, by use of (|6.4[) and (|6.46p . we have 

x N \i(k\k) = x(k) - x N \i(k\k) 

Tli — 1 Tii — 1 

= n t [J2 A'^Xiil) - m[J2 A- m ]- x Xi(l\l) (6.50) 

m— m— 

rii-1 



= n l [Y J A- m r 1 xm) 



therefore, 

P W |i(fc|fc) = E{x mi {k\k)x T N]i {k\k)} 

rii — 1 n ? - — 1 

m— m— 

For fc = rij/ + p, p = 1, 2, • • • ,m - 1, by use of flU]), flO]) and ([Q6j) . we 
obtain 

XAT|i(fc|fc) = ic(fc) - £jV|j(fc|fc) 

= x(riil + p) — x N \i{nil + p\nil + p) (6.52) 

p-i 
= A p x(riil) + y A w(riil + p — 1 — I) — x N u(riil + p\riil + p) 



1=0 
rti—l p— 1 

m=0 



t A p [J2 A- m ]- l Xi(l\l) + J2 A l w{nJ +p-l-l) 
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and 

m—x fii — i p—i 

= nj^ A-r'T'mimY. A~ m r T ^ T +J2 Al Q Al ' T 

ro=0 m=0 1=0 

(J6.51I) and (16.53)) can be rewritten as (|6.27p . This concludes the proof of 
Theorem 2. 

Remark 6.5. From (|6.38[) we could get (|6.37p , the reason is that from the 
problem formulation, we know that y;(l) — CiXi(l) is zero-mean white Gaus- 
sian sequence. Based on the property of the normal distribution, one has 
P{[ Vl {l) - CiXi(l)][yi(l) - CM^V < V25) = 0-9544, where P{A) means 
the probability of A. So, if we choose A lager than 4, (|6.37p is true in the 
probability of lager than 0.9544. 

After Theorem 16.31 and Theorem 16.41 the following result could be obtained 
immediately. 

Theorem 6.6. The state fusion estimation algorithm generated by Theorem 
\6.4\ is meaningful and convergent, and we have 

P{k\k) < P N \i(k\k) (6.53) 

and 

lim P(k\k) < P (6.54) 

k — >oo 

where P is a constant positive matrix. 

Proof. (|6.53[) can be drawn from (|6.24[) directly since for each i = 1, 2, • • • , N, 
Ppf\i(k\k) is nonnegtive. In fact, Pffu{k\k) is generally positive, in this case, 
we have P(k\k) < Pmi(k\k). On the other hand, from Theorem l6.4l we have 

N 

p{k\k) = c£p^mr l 

i=\ 

< max{P N (k\k), P N {k\k - 1)} (6.55) 

= max{P N (k\k), A N P N {k - l|fc - l)A T N + Q t } 

therefore 

lim P(k\k) < lim [max{P N (k\k), A N P N {k - l|fc - l)A T N + Q l }} 

k — s-oo k— »oo 

= max{ lim P N (k\k), lim [A N P N {k - l\k - 1)A% + Q N }} 

k^>oc k— >oo 

= max{PAr, AP N A T + Q} 
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where Pjy(k\k) denotes the estimation error covariance of x(k) based on Sen- 
sor N without measurements missing, and Pjq denotes the steady value of 
P N {k\k). 
Denote 

P = max{Pjv, AP N A T + Q} (6.56) 

and (I6.54[) can be directly generated. 

Remark 6.7. Theorem 16.61 indicates two facts: (1) The presented data fusion 
state estimation algorithm is effective. From (|6.53p . one can see that the fused 
state estimate error covariance is smaller than those from each single sensor's. 
(2) The presented algorithm is meaningful. From (|6.54p . one can see that the 
presented algorithm is convergent. 

Remark 6.8. For simplicity and without lose of generality, in Theorem 16.41 
the effects of the cross-covariances among the local state estimation errors 
were not considered. In considering of the estimation error cross-covariances, 
the global optimal fused state estimate could be obtained by generalizing the 
results given by |174j from single sampling rate synchronous data fusion to 
the formulated problem: 

N 

x{k\k) = J2 a ^ £ mi( k \ k ) ( 6 - 57 ) 

P(k\k) = (e T (k)Z- l (k)e(k))- 1 (6.58) 

where 

{a 1 (k)a 2 (k) •■■ a N (k)) T = S- 1 (k)e(k)(e T (k)IJ- 1 (k)e(k))- 1 (6.59) 

P N \ %3 (k\k) = E{[x(k) - x Nlt (k\k)}[x(k) - x NU (k\k)f} 

= E{x Nli (k\k)xl {j (k\k)} (6.60) 

and where e(k) — (I n I„ ■ ■ ■ I n ) T is the nN x n matrix and /„ denotes the 
identity matrix of dimension n. S(k) = (Pjyu,-(fc|A;)) is an nN x nN matrix 
whose ijih block is P^\ i j(k\k) : i,j = 1,2, • • • , N. xjfu(k\k) and xJj,Ak\k) in 
(|6.60|) are given by (|6.50p and (|6.52p . for k mod n, = and k mod m ^ 0, 
respectively, i, j = 1, 2, • • • ,N. In this case, similar as |174j . by use of Schwartz 
matrix inequality, it can be easily proven that Theorem 16.61 also holds. 



The sketch of the proposed algorithm is illustrated in Fig. 16.21 where two 
sensors are shown with the sampling ratio being 2. The legends of the blocks 
are: 



6.4 Simulations 
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The measurements 

The estimate based on single sensor at the corresponding scale 

The estimate at the finest scale based on single sensor 

The fused state estimate 

Observations of sensor 2 at scale 2 

Estimate of the state at scale 1 based on sensor 2 

£ 2]2 (k | k) = x. 2 (l\ I) 

The fused state estimate at scale 2 based 
on sensors 1 and 2 

Estimate of the state at scale 2 based on sensor 1 

Estimate of the state at scale 1 based on sensor 1 
Observations of sensor 1 at scale 1 




Fig. 6.2 The illustration of the presented state estimation algorithm. 



6.4 Simulations 



To demonstrate the performance of the proposed algorithm, an example is 
illustrated in this section. A radar tracking system with three sensors can be 
described by [104| 

"1 TT 2 /2~ 
x(k + l) = 1 T x(k)+w(k) 
1 

Vi(k) = ji(k)CiXi(k) + Uj(fc), i = 1, 2,3 

where T is the sampling period. The state x(k) — [s(k) s(k) s(k)] T , where 
s(k), s(k), and s(k) are the position, velocity and acceleration, respectively, of 
the target at time kT. yi(k)(i = 1, 2, 3) are the measurements of three sensors, 
which observe the acceleration, the velocity and the position, respectively, i.e., 
Ci = [0 1], C-i = [0 1 0], C3 = [100]. Vi(k) are zero-mean Gaussian noises 
with variances Ri, and are independent of white Gaussian noise w(k) with 
zero-mean and variance Q. In the sequel, one should generate the estimate 
of x{k) by fusing the information from three sensors. 

In this simulation, set T = 0.01s, Q = 0.01, R 3 = 0.25, R 2 = 0.09, and 
i?i = 0.01. The stochastic variable 7, 6 R is a Bernoulli distributed white 
sequence taking values on and 1, whose mean is %. Here, we take 71 = 0.9, 
72 = 0.8, and 73 = 0.8. It means that the measurements are missing at the 
probability of 0.1, 0.2 and 0.2, respectively. The initial values are x(0) = 
[10 0] T and Pq — I3. Sensor 1, sensor 2, and sensor 3 sample 100, 150 and 
300 data, respectively. 
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The Monte Carlo simulation results are shown in Table 1, and Figs. !6.3l to 



In Fig. 16.31 the measurements of the three sensors are shown, where (a), (c) 
and (e) denote the measurements from sensors 1, 2 and 3, respectively, under 
the assumption that all the measurements are normal. Figs, (b), (d) and 
(f) of Fig. 16.31 are the real measurements of sensors 1, 2 and 3, respectively, 
with the measurements randomly missing. From Fig. 16.31 one can see that 
the data missing of each sensor is obvious. In Fig. 16.41 the first dimension of 
the original signal (blue real line) and the estimate signals (the red dashed 
line) are illustrated, where the dashed lines in (a) through (d) denote: the 
Kalman filter of sensor 3, the estimate by use of the algorithm presented 
in [194] . the estimate by use of the algorithm presented in 211J, and the 
estimate by use of the presented method, respectively. The corresponding 
estimation error curves are drawn in Fig. 16.51 From Fig. 16.41 and Fig. 16.51 one 
can observe that the traditional Kalman filter and the algorithm proposed by 
|211j are divergent in the case of measurements randomly missing. However, 
the algorithm presented by [194j and the proposed algorithm are effective. 

In Fig. 16.61 the Monte Carlo simulation curves of 100 runs are shown, 
where (a) through (d) are the statistical estimation errors of (i) the result 
based on Kalman filter of sensor 3, (ii) the result based on the algorithm 
presented in |194j . (iii) the result based on the algorithm presented in |211| . 
and (iv) the result by use of the proposed algorithm, respectively. From Fig. 
6.61 one can see that the proposed algorithm is also effective in the sense of 
statistics. However, statistically, the algorithm in |194j is divergent. 

The values listed in Table 16.11 are the means of the absolute values of the 
estimation errors, which is computed by -^j X) 7 =i Sfe=i fe WOI) where K = 
360 denotes the number of the sampling points of sensor 3, J = 100 denotes 
the Monte Carlo simulation runs, while Xj(k\k) denotes the estimation error 
of the state at the jth run. Six schemes are tested and listed in Table 16.11 
for the proposed algorithm: (i) Kalman filter of sensor 1; (ii) Kalman filter of 
sensor 2; (iii) Kalman filter of sensor 3; (iv) by use of the algorithm presented 
by |194] to generate the state estimate by use of measurements from sensor 
3; (v) by use of the algorithm presented by [21 lj to fuse three sensors and 
generate the state estimate; (vi) by use of the presented algorithm to fuse 
sensors 1, 2 and 3. The second to fourth rows of Table RTTl denote the statistical 
means of the absolute values of the estimation errors of position, velocity, and 
acceleration, respectively. 

From Table IBTTl one can notice that, because of the randomly missing of 
measurements, statistically, both Kalman filter (Observe the second to the 
fourth lines of Table 16.11 and algorithm in [194j and [211] , Observe the fifth 
and the sixth line of Table 16. ip are divergent. The reasons are: (1) When 
there are measurements randomly missing, the measurement error variances 
became very large. In this case, Kalman filter still updates in the same way 
as the measurements are not missing, which results in divergence. (2) The 
algorithm of |211j is the generation of Kalman filter to multiple sensors. So, 
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Fig. 6.3 Measurements with and without missing. 
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- the estimate using Kalman tltering 
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Fig. 6.4 The original signal and the estimate signals. 

Table 6.1 The statistical means of the absolute values of the estimation errors 



state 



(i) (ii) (iii) (iv) (v) (vi) 



position 10.4958 13.3191 230.0571 46.7013 226.7272 2.1055 
velocity 7.3700 22.2880 33.0451 9.6595 32.0598 1.9001 

acceleration 2.5496 5.2736 9.5893 7.5492 5.5450 1.1923 
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Fig. 6.5 The estimation errors corresponding to Fig. 16.41 
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Fig. 6.6 The statistical estimation errors. 
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it has the same problem as Kalman filter. (3) The algorithm presented by 
|194j , which takes measurements missing into consideration, is more effective 



than Kalman filter and even than the fusion algorithm proposed by 211J. 
From Fig. I6.4l and Fig. 16.51 one can observe that it is effective in simulation 
of randomly one run. However, stochastically, it is not so effective. It means 
the stability of algorithm 194 is not as good as the presented algorithm. 
(4) The bad measurements are checked out and properly dealt with in the 
presented algorithm, which result in the convergence of the results. 
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Briefly, the simulation results in this section illustrate the effectiveness of 
the presented algorithm. 



6.5 Summary 

When a target is observed by multiple sensors that sample asynchronously 
at different sampling rates with the measurements randomly missing, a state 
estimation algorithm has been presented in this chapter. From theoretical 
analysis and simulation results, it can be concluded that the proposed algo- 
rithm is effective and has potential value especially in some application fields, 
such as target tracking, integrated navigation, network transportation, and 
fault tolerance, etc. 



Part III 
Predictive Control over Networks 



Chapter 7 

Networked Predictive Control Systems 

with Data Dropout 



7.1 Introduction 

In recent years, networked control and data fusion technology have become 
popular control problems which have been extensively studied under various 
assumptions and scenarios [Ml H3SJ Mi UM ISO H EOS]- There has been a 
growing interest in the design of controllers based on the network systems 
such as traffic, communication, aviation and spaceflight 236J. Particularly, 
the rapid rising of Internet makes Internet based control systems accomplish 
remote monitoring and adjustment over a long distance. This makes the con- 
trol systems benefit from the ways of retrieving data and reacting to plant 
fluctuations from anywhere around the world at any time [3H 11791 11291 1127| . 
In NCSs, the plant, controller, sensor, actuator and reference command are 
connected through a network. As the structure of NCSs is different from that 
of traditional control systems, there exist various specific problems in NCSs, 
for example, network delay, loss of data packets, network security and safety 

Several methodologies have been reported in the open literature to han- 
dle with the problems mentioned above in networked systems. Among these 
papers, two basic control strategies are applied when the packet dropping 
happens, they are zero-input schemes, by which the actuator input is set to 
zero when the control packet is lost, and hold-input scheme which implies 
the previous control input is used again when the control packet drops. The 
further research is proposed in |156| by directly comparing the two control 



methods. In [229 , the stability problem of closed-loop NCSs in the pres- 
ence of network delays and data packet drops has been addressed under an 
assumption that the network-induced delay is less than the sampling pe- 
riod. To reduce network traffic load, a sampled-data NCSs scheme combining 
the model-based control methods has been presented and some necessary 
and sufficient conditions for globally exponential stability of the closed-loop 
systems via state/output feedback without/with network delays have been 



Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 109 4125 
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established in |121) . In |221) . a new model of NCSs is provided under con- 
sideration of both the network-induced delay and the data packet dropout 
in the transmission. State feedback stabilizing controller is proposed based 
on the delay-dependent approach and the maximum allowable value of the 
network-induced delay can be determined by solving a set of LMIs. Since Hoa 
control can make a well established connection between the performance in- 
dex being optimized and performance requirements encountered in practical 
situations, the method is proposed in |160j where the packet dropouts and 
channel delays are modeled as Markov Chains with the usual assumption, 
that is all the transition probabilities are completely accessible. The work 
of |106j present a novel control technique combining modified Model Predic- 
tive Control (MPC) and modified Smith predictor to guarantee the stability 
of NCSs. Especially, the key point in this paper is that the future control 
sequence is used to compensate for the forward communication time delay 
and predictor is responsible for compensating the time delay in the backward 
channel. In |110j . a novel networked predictive control method is proposed 
to deal with NCSs with random time-delay existing in both feedback and 
forward channels. The dynamics of the plant is explicitly used to derive a 
sequence of forward control predictions, which are sent to the actuator si- 
multaneously and the actuator chooses the appropriate one to compensate 
for the delays. 

Although much research work have been done in NCSs, many of those 
results simply treat the NCSs as a system with time delay, which ignores 
NCSs' features, e.g., random network delay and data transmission in packets 



[200 . In order to solve the problem, Markovian jump system can be used 
to model the random time-delay. Moreover, most work have also ignored 
another important feature of NCSs. This feature is that the communication 
networks can transmit a packet of data at the same time, which is not done 
in traditional control systems. Therefore, in this chapter, we will make full 
use of this feature and propose a new networked predictive control scheme 
which can overcome the effects caused by network data dropout modeled as 
Markov chain. 

This chapter is organized as follows. Section lT^l presents a novel networked 
predictive control scheme such that the closed-loop system is asymptotically 
stable. Section 17.31 gives a review of other control methods for NCSs. The 
furuta pendulum of a NCSs is modeled with random packet dropouts in Sec- 
tion [731 Numerical simulations are presented in Section [7.51 Some conclusion 
remarks are given in Section 17.61 

7.2 Networked Predictive Control for Systems 

To overcome unknown network transmission dropout, a networked predic- 
tive control scheme is proposed. It mainly consists of a control prediction 
generator and a network dropout compensator. The control prediction gen- 
erator is designed to generate a set of future control predictions. The network 
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dropout compensator is used to compensate the unknown random network 
dropout. The structure of the networked predictive control system (NPCS) 
is shown as Fig. 17.11 This chapter mainly focus on the random transmission 
data dropout existing in both feedback and forward channels in NCSs. So, 
the network-induced time delay is not discussed here. 

Consider a MIMO discrete system described as the following state space 
form 

x(k + I) = Ax(k) + Bu(k) + w(k) . . 

y(k) = Cx(k) + v(k) l ' 

where x(k) £ R n , u(k) £ R m , and y(k) £ R l are the system state, input, and 
output vectors, respectively. The noise process {w(k)} is a white, zero-mean, 
uncorrelated one with known covariance matrice Q±. A, B, C are matrices of 
appropriate dimensions. For the simplicity of stability analysis, it is assumed 
that the reference input of the system is zero and the following assumptions 
are hold. 

The arrival of the observation at time k is a binary random variable "f(k) 
with probability distribution P(^(k) = 1) = Xk,^k £ (0,1) and j(k) is 
independent of "f(s) if k ^ s. The output noise is defined as 

v (k)~l N ^ R ^^^ = 1 (12) 

for some a 2 . 

Assumption 7.1. (A, B) is completely controllable and (A,C) is completely 
observable. 

Assumption 7.2. The number of consecutive data dropouts must be less than 
N (a positive integer). 

Remark 7.1. In a real NCS, if a data packet does not arrive at a destination 
in a certain transmission time, it means that the data packet is lost based 
on the commonly used network protocols. From the physical point of view, it 
is natural to assume that only a finite number of consecutive data dropouts 
can be tolerated in order to avoid the NCS to be an open-loop. Thus, the 
number of consecutive data dropouts should be less than a finite number N. 

Some notations are defined as follows: 

Y(k) = ly(0),--- 7 y(k)] T 

r(fc) = [ 7 (o),--., 7 (fc)r 

x{k\k) =E[x(k)\Y(k),r(k)] 

P(k\k) = E[(x(k) - x(k\k))(x{k) - x(k\k)) T \Y(k),r(k)} 
x(k + ljfc) = E[x(k + l)\Y(k), r(k)\ 

P(k + ljfc) = E[(x(k + 1) - x(k + l|fc))(s(* + 1) - x(k + l|fc)) T |F(fc),r(fc)] 
y(k+l\k)=E[y(k + l)\Y(k),r(k)} 

(7.3) 
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Fig. 7.1 The networked predictive control system. 



The Kalman filter based state observer is designed as 

x(k\k - 1) = Ax(k - l\k - 1) + Bu(k - 1) 

z(fc|fc) = x(k\k - 1) + y(k)K(k)(y(k) - Cx(k\k - 1)) 
P(fcjfc) = P(k\k - 1) - -f(k)K{k)CP[k\k - 1) 
if(fc) = P(fc|fc - l)C* T (CP(fc|fc - l)C T + R)- 1 



(7.4) 



where x(k + l\k) € R n and u(fc|fc) £ i? m are the one-step ahead state predic- 
tion and the input of the observer at time k, respectively. P(k\k — 1) is the 
solution of the following modified Riccati equation [169j 



P{k\k - 1) = AP(k - l|fc - 2)A T +Q- j(k)AP(k - l|fc - 2) 

xC T (CP(k - l|jfc - 2)C T + R)- x CP{k - \\k - 2)A 7 

The state predictions at time k are constructed as 



(7.5) 



x(k + l\k) = Ax(k\k - 1) + Bu(k) + j(k)AK(k)(y(k) - Cx(k\k - 1)) 
x(k + 2\k) = Ax(k + l\k) + Bu(k + l\k) 



x(k + N\k) = Ax(k + N - l|fe) + Bu(k + N- l\k) 
Assume that the controller is of the following form: 

u(k) =u(k\k) = L{k)x(k\k) 



(7.6) 



(7.7) 



where L(k) € Ji mxn [ s th e state feedback control matrix to be determined 
using modern control theory. Then, the control predictions are generated by 

u(k + t\k) =L(k)x(k + t\k),ior t = 0,l,2,---,N (7.8) 

Thus, it follows from equation (|7.6p that 

x(k + t\k) = (A + BLik)) 1 - 1 ^ + l\k) (7.9) 
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Based on equations ([7. 41) . (|7.6[) and (|7.8|) . it can be shown that 

x(k + t\k) 
= (A + BLifyy-^Axiklk - 1) + Bu(k) + j(k)AK(k)(y(k) - Cx(k\k - 1))] 
= (A + BLik)) 1 - 1 ^ + BL(k) - 1 {k){AK{k) - BL{k)K(k))C)x(k\k - 1) 

+j(k)(AK(k) + BL(k)K(k))Cx(k)} 

and 

u(k + t\k) 
= L(k)x(k + t\k) 
= L(k)(A + BL(fc))*- 1 [(A + BL(k) - 1 {k)(AK(k) - BL(k)K(k))C) 

xx(k\k - 1) + 1 {k){AK{k) + BL{k)K(k))Cx{k)] (7.10) 

In order to compensate the network transmission data loss, a network delay 
compensator is proposed. A very important characteristic of the network is 
that it can transmit a set of data at the same time. Thus, it is assumed 
that predictive control sequence at time k is packed and sent to the plant 
side through a network. The network delay compensator chooses the latest 
control value from the control prediction sequences available on the plant 
side. For example, if the following predictive control sequences are received 
on the plant side: 

[u T (k\k),u T (k + l|fc), • • • , u T (k + N- l|fc), • • • , u T (k + N\k)] T (7.11) 

then u(k\k) is used as the input to the actuator. If new control package con- 
taining control predictive sequences is dropped at the next step, one step 
control prediction u(k + l\k) will be used as control input to the actua- 
tor. Then, if new package of control predictive sequences are received, then 
the first control input will be used as the input to the actuator. Otherwise, 
u{k + 2|fc) will be used as input to the actuator, ... and so on. Based on the 
assumption, it is reasonable that there are N times consecutive data dropout 
at least. The stochastic stability criteria of the closed- loop networked pre- 
dictive control systems can be analytically derived based on the methods in 
previous work |110j . In fact, using the networked predictive control scheme 
presented in this section, the control performance of the closed-loop system 
with data dropout is very similar to the one without data dropout. 



7.3 Previous Work for Networked Control Systems 

Some strategies have been declared for dealing with NCSs. In this section, 
many of representative control schemes are reviewed. 
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7.3.1 Another Networked Predictive Control Based 
on State Observer 

A predictive control scheme for NCSs with random network delay and packet 



dropout in both forward and feedback channels has been studied in [llOj . 
The control method also utilizes the characteristic that it can transmit a 
set of data at the same time via networks. Similarly, control predictors and 
compensators are built to reduce the impact caused by time delay and data 
dropout. It is assumed that control predictions at time fc are packed and sent 
to the plant side through a network. On the actuator side, only the control 
latest prediction sequence is kept. The network delay compensator chooses 
the control value from the control latest prediction sequence. The model 
considered here is similar to (|7.1[) but without considering system noise and 

measurement noise. 

x(k + 1) = Ax(k) + Bu(k) , , 

y{k) = Cx{k) [ ' 

In particular, for NCSs without time delay and the state feedback control 
u{k) = K m x(k\k — 1) is considered and the state predictions at time k are 
finally constructed as follows: 

x(k + l\k) = (A + BK m - L m C)x(k\k - 1) + L m Cx(k) 
x(k + 2 fc) = Ax(k + l|fc) + BuVk + l\k) 

• (7.13) 

x(k + N\k) = Ax(k + N - l\k) + Bu(k + N - l\k) 

The control predictions are calculated by 

u(k + t\k) = K rn x(k + t\k) (7.14) 

It should be noted that the control strategy proposed in [1 10] can be used in 
the NCSs with both time delay and data dropout. Here, the control approach 
is revised to deal with NCSs without time delay. It is shown that if the data 
is lost within the current sampling period, the control input should be taken 
as the ith-step ahead control prediction of the current time, which is received 
in the previous sampling period. In the same way, when the data dropout 
happens in the feedback channel, the observer will use the measurement out- 
put y(k — 1) received at the last sampling instant if the measurement output 
y{k) is lost; otherwise, y(k — j) will be used if y(k — i) arrives after y(k —j), 
where j < i. These methods play a very important role in compensating 
for data dropout in the proposed NPC implementation. When data dropout 
exists in both forward and feedback channels, the scheme proposed in this 
chapter can achieve the desired control performance, which is similar to that 
of the system without data dropout. Thus, on the sensor side, the measure- 
ment output is sent to the controller side through the feedback channel. On 
the controller side, the control prediction sequence at time fc, which consists 
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of the future control predictions, is packed and sent to the plant side through 
the forward channel. The compensator chooses the latest control value from 
the latest control prediction sequence on the plant side. 

7.3.2 Zero Control and Zero- Order Hold Control 

In literature, two basic control strategies are applied when packet dropping 
happens. They are zero-input scheme, by which the actuator input is set to 
zero when the control packet is lost, and hold-input scheme, which implies the 
latest control input is used again when the control packet drops. Generally, 
the two methods are applied only in the forward channel concerning whether 
the control packet is obtained or not. Here, the methods are extended in both 
feedback and forward channels. 

i) Zero-input method 

Zero-input scheme can be described as follows. Consider the stochastic 
system [55] 

x(k + 1) = Ax(k) + a(k)Bu(k) , . 

y{k) = (3{k)x{k) {< b > 

The plant is remotely controlled over a network containing random packet 
losses. The stochastic process a(k) and (3(k) depict the unreliable nature of 
the network. Basically, a(k) = when the transmission from the controller 
to the plant fails, i.e. the control packet is lost, and a(k) — 1 when the 
control packet is successfully acquired in the forward channel. The link from 
the plant to the controller is unreliable as well, f3{k) = when the link from 
the sensor to the controller fails, and P(k) = 1 when the measurement packet 
is correctly obtained in the feedback channel. 

ii) Hold-input method 

Consider system ()7.12|) , on the condition of hold-input scheme applied in 
both forward and feedback channels, the measure y(k) is chosen as y{k) = 
y(k — 1) if dropout happens in the feedback channel, and in the forward 
channel, if the control packet is lost, the actuator could employ the previous 
control value u(k) = u(k — 1). 



7.4 Digital Control Design of Furuta Pendulum 

In this section, in order to construct the NCS, we will adopt a nonlinear 
furuta pendulum which can be linearized as a plant and introduce Markov 
process to depict the random packet dropout. 
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7. 4-1 Furuta Pendulum Model 

Consider a single inverted pendulum which contains two parts, a vertical 
level of the inverted pendulum and a horizontal arm. The structure of the 
furuta pendulum is shown in Fig. 17.21 where (f> is the arm angle, 9 denotes 
the pendulum angle, <j> and 9 present their angular velocity respectively. 




Fig. 7.2 Structure of the Furuta pendulum. 



The nonlinear dynamics of the furuta pendulum using Euler-Lagrange 
equations has been researched in many reports, for example, in [53) . 

& = a ^+(^)s^ e {P( a + P sin2 0) cos e sin *& 
+2/37(1 -sin 2 9) sin 9<j)9 
— 7 2 cos 9 sin 99 2 + 5 (a + [3 sin 2 9) sin 6 — 7 cos 9 x t} 

Tt<S>= aff-^+cA^Bin^ ^Csin 2 0-1) sin 9<f> 2 - 2/3 2 cos 9 sin 
— 7^ cos 9 sin 9 + /3 x t} 



(7.16) 



where 



a = {M + -)l\ (3 = J+(M+my, 7 = (M+-)rl, S = (M+-)gl (7.17) 

The notation M, m, I, r, J, g denote the parameters used in the furuta 
pendulum model, which is shown in Table 17.11 r € R is the input torque 
which can be divided into a driving torque and its consumption of friction 



r = t u -t f 



(7.18) 
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where the friction tf can be modeled as coulomb friction with stiction 

{T c sgn<j> if (/> ^ 
t u if <j) = and \t u \ < t s (7-19) 

t, otherwise 



Table 7.1 Parameters used in the Furuta pendulum model 



Symbol 



Value 



Meaning 



rn 


0.025 Kg 


M 


0.004 Kg 


I 


0.241 m 


r 


0.152 m 


J 


1.21e" 3 Kg- 


9 


9.81m/s 2 



Mass of pendulum rod 
Mass of pendulum ball 
Length of pendulum rod 
Length of horizontal arm 
i 2 Moment of inertia of central shaft 
Gravitational constant 



Introducing the state variable 

x = (e e 4>4)) J 

and linearized pendulum model 53 



x = Ax + Bu = 



100 
000 



a 6 



a/3 — ~y' 2 

o 001 



-■yS 



ol0— 7 ; 



000 



x + 


' " 

-7 


a(3 — 7 2 



13 


- a/3— 7 2 - 



(7.20) 



(7.21) 



7-4-2 Random Network Data Dropout Model 

The problem of network data dropout over a network has been proposed in 
(1411 [89] . some types of model have been established. The networks can be 
described as having long periods of good performance and relatively short 
periods of bad performance. The two-state Markov chains are the simplest 
model to capture the behavior accurately, which are described in Fig. 17.21 
The parameters fjj and e, are transition probability depicting the switching 
movement between two states. 

The model explicitly switches between a good network state and a bad one 
with state-based transition probability. If the network is in a good state, it 
has a higher probability to move the good state in next stage to a bad one. 
Similarly, if the network is in a bad state, it has a higher probability to keep 
the bad state and a lower probability to switch to a good state. In addition, 
packet dropout appears for either states. The probability of individual packet 
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Table 7.2 Parameters in the 2-state Markov model 

Symbol Value Meaning of Probability transition 

ro,i 0.005 Good state to Bad state of the network 

ro,o 0.995 Good state to Good state of the network 

ri.o 0.0027 Bad state to Good state of the network 

ri,i 0.9973 Bad state to Bad state of the network 
eo 0.01 Data drop out in the Good state 

ei 0.90 Data drop out in the Bad state 



Tin 




r ,i 
Fig. 7.3 Two-state Markov chain network model. 

loss in the bad state is more significant while the probability is quite small 
in good state. 

Based on above description, the data dropout can be modeled as follows. 
Consider S(k), j(k) at any time k > 0, where S(k) = denotes the good 
state and S(k) — 1 represents the bad state. The variable -f(k) determines 
whether data dropout appears in the network. Here, j(k) = means that 
the dropout happens and j(k) = 1 means not. Given S(k), the chain's next 
move can be specified by: 



where U\ , Ui are random variables following a uniform distribution on the 
interval [0, 1]. 



7-4-3 Structure of Controller 

The optimal control of LQR scheme is adopted here for the control design. 
The objective is to design a discrete state feedback controller 



-Lx (7.24) 
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to stabilize the pendulum system ()7.21[) by minimizing the quadratic cost 
functional 



A 



J = lim y^(x T (k)Qx(k)+u T (k)Ru{k)) 

TV— »oo ^ — 4 



(7.25) 



k=0 



7.5 Simulation Results 

In order to demonstrate the effectiveness of the proposed predictive control 
scheme (|7.10|) . numerical simulations have been performed and presented 
comparing with another three kinds of control methods in this section. The 
plant is chosen as furuta pendulum model (|7.21|) with (|7.17[l and the pendu- 
lum parameter values are selected in Table l7Tl This section gives the trajec- 
tory curves of the arm angle <f> and pendulum angle 9 when the horizontal 
arm tracks the square- wave signals. The numerical simulations are discussed 
in three steps. We first consider the model of the furuta pendulum (|7.21j) 
and LQR state feedback control law (J7.24I) without data dropouts and noise. 
Then, four control methods are applied for NCSs with data dropout, and 
we will show that the two predictive control schemes are superior than zero- 
input and input-hold control approaches. Especially, in the high dropout rate 
condition, the predictive control methods can perform much better. Finally, 
the two predictive control methods are considered on the conditions of NCSs 
with packet loss and noise, and the simulation results indicate that the pre- 
dictive control strategy we proposed in this chapter has the best performance 
when data dropout and noise appear in the network simultaneously. 



7.5.1 



Track a Square- Wave Signal without Network 
and Noise 



Consider the model of the furuta pendulum (|7.21|) and LQR state feedback 
control law (|7.24(1 without data dropouts and noises. The parameters in cost 
function (J7.25D are selected as 



Q 



300 





0" 





100 











30 








3 



R = 1000 



(7.26) 



which yield the feedback gain 

L= [-2.094 -0.378 -0.117 -0.092] 



(7.27) 



The horizontal arm tracking square-waves and the trajectory of pendulum 
angle are depicted in Fig. 17.41 which indicates that, without networks and 
noises, the arm tracking and pendulum stability can be guaranteed under the 
LQR state feedback control law. 
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7.5.2 Track a Square- Wave Signal with Network 
without Noise 



In this part, we will consider the NCSs with data dropouts. In order to 
construct a NCS with random packet loss which is depicted by Markov chains, 
the transition probability in Markov model (|7.22J) is selected as Table 17.21 
System performances of the four kind of control methods are shown when 
the data dropout happens in both the forward and feedback channels. 

System performances for zero-input control approach with random data 
dropouts are shown in Fig. 17.51 and Fig. 17.61 When data dropout happens 
in the forward and feedback channels, the input of the actuator is set to be 
zero. Fig. 17.51 gives the result with 10% data dropouts and Fig. 17.61 presents 
the result with 18% data dropouts. It is obvious that the control loop will 
be instability as the data dropout rate raised. With the data dropout rate 
raised to 18%, the horizontal arm can not track the square-wave signal and 
the pendulum arm can not keep in the upright position, which means that 
this method can not control the system with high data dropout rate. 



Tracking of s oior-a for 2UOHz control witfiofi ristworK 




Fig. 7.4 Tracking of a square-wave for 200 Hz control without network and noise. 



Simulation results for hold-input control scheme with data dropouts are 
shown in Fig. 17. 71 and Fig. 17.81 As seen in Fig. 17.71 it can guarantee the stable 
tracking for the case of 40% data dropouts following a random distribution, 
but with the increased data dropout rate, the pendulum switches to be un- 
stable, which is shown in the Fig. 17.81 with the data dropout rate of 48%. It 
is significant that the hold-input control scheme can maintain the trajectory 
tracking at an even higher data dropout rate than the zero-input control 
approach. However, the system becomes unstable when data dropout rate is 
larger than 48%. 
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Tracking of a signal for 2D0Hz control with network 




Fig. 7.5 Tracking of a square- wave for 200 Hz Zero control with 10% data 
dropouts. 



Tracking of a spinal for 2UOHz control with network 




Fig. 7.6 Tracking of a square- wave for 200 Hz Zero control with 18% data 
dropouts. 



The arm tracking and stability of pendulum for the two predictive control 
schemes are described in Fig. 17.91 and Fig. 17.101 It is clear that, for both 
predictive methods, when we put the prediction generator into the controller 
and the network data dropout compensator into the actuator, the stability 
of pendulum can be guaranteed with high data dropout rate. Fig. 17.91 shows 
the simulation result for network predictive control (|7.13p based on the state 
observer with the 48% data dropouts and Fig. 17.101 shows the simulation 
result for network predictive control (|7.10p based on the Kalman filter with 
the same data dropout rate. As seen in the two trajectories, the arm can 
track the square- wave signal well with the small overshoot and the pendulum 
also can be stabilized in the vertical position. As expected, the performance 
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Tracking of a signal for 2D0Hz control with network 




Fig. 7.7 Tracking of a square- wave for 200 Hz input- hold control with 40% data 
dropouts. 



Tracking of a spinal for 2UOHz control with network 




Fig. 7.8 Tracking of a square-wave for 200 Hz input-hold control with 48% data 
dropouts. 



of the system is improved dramatically with the predictive control algorithms 
compared with the zero-input and input-hold control approaches. 



7.5.3 Track a Square- Wave Signal with Network and 
Noise 



It has been shown that the two predictive control methods perform much 
better than other control schemes for resisting the packet loss. On the other 
hand, noise is also an ingredient affecting the performance of the system. In 
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Tracking of a signal for 200Hz control with network and prediction 




Fig. 7.9 Tracking of a square- wave for 200 Hz control based on the state observer 
with 48% data dropouts. 
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Fig. 7.10 Tracking of a square- wave for 200 Hz control based on the Kalman filter 
with 48% data dropouts. 



this subsection, we concern about the NCS with both data dropout and noise 
under the two predictive control schemes. 

Consider NCS (|7.ip with noise and data dropout (|7.22p . the covariance of 
noise {w(k)} and {v(k)} are selected as 
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(7.28) 
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The predictive control (|7.13p based on state observer is shown in Fig. l7.Hl and 
the predictive control (|7.10[) based on Kalman filter is depicted in Fig. 12. Due 
to the process noises, the performance of the system become worse than the 
system without noise at the same rate of the data dropouts. Compared Fig. 11 
with Fig. 17.121 it is clear that the performance of the predictive control based 
on Kalman filter we proposed is better than the predictive control based on 
state observer. This indicates that the proposed predictive control based on 
Kalman filter can keep an outstanding system performance when the data 
dropout and noise exist in the network. 



Trsckmc: of a signa tut 200Hz control with network prediction and noise 




Fig. 7.11 Tracking of a square- wave for 200 Hz control based on the state observer 
with 40% data dropouts and processes noise. 



Tracking of a signal tot 20QHz control with network, Kalprediction and noise 




Fig. 7.12 Tracking of a square- wave for 200 Hz control based on the Kalman filter 
with 40% data dropouts and processes noise. 
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The control behaviors of zero-input and input-hold approaches have been 
discussed in many aspects |156] . The numerical result of the pendulum NCS 
shows that the input-hold control scheme performs better than zero-input 
control approach for resisting the data dropout. In this simulation, input- 
hold control approach can guarantee the system stable until the dropout rate 
reaches to 48% while zero-input control method with the data loss rate to 
18% (see Fig. 17.61 and Fig. I7.8J I. However, both the two methods are not so 
excellent as predictive control approaches which can guarantee the stability 
of the pendulum and arm tracking at the 48% data dropout rate (see Fig. 17.91 
and Fig. 17.10]) . Moveover, the proposed predictive control approach based on 
Kalman filter (|7.10[) performs better than the predictive controller (|7.13p on 
noise attenuation since the advantage of Kalman filter over state observer is 
noise resistance (see Fig. 17.111 and Fig. I7.12|) . 



7.6 Summary 

A new networked predictive control scheme based on Kalman filter has been 
proposed for MIMO networked distributed control systems with random 
network data dropout. Based on the network feature of transmitting a set of 
data at each time, the proposed networked predictive controller consists of 
the control prediction generator and the network data loss compensator. The 
former one provides a set of future control predictions to satisfy the system 
performance requirements. The latter compensates for the random network 
transmission packet loss. Simulation results are presented to illustrate the 
effectiveness of the proposed predictive control strategy via comparing with 
other three existing control schemes. 



Chapter 8 

Networked Control of Systems with 

Predictive Compensator 



8.1 Introduction 

With the development of network technology, an increasing number of net- 
work technology has been applied to control systems. The networked control 
has became a new area in control systems. In this chapter, we will make full 
use of the network feature and propose a new networked predictive control 
scheme with the optimal estimation. 

This chapter is organized as follows. Section [5121 presents a novel networked 
predictive control scheme and an optimal estimation method for the state 
estimate such that the closed-loop system is asymptotically stable. The linear 
inverted pendulum of a NCS is modeled with random time delay and packet 
dropouts in Section 18.31 Numerical simulations are presented in Section [ 
Some conclusion remarks are given in Section [ 



8.2 Networked Predictive Control for Systems 

In this section, a networked predictive control scheme, which mainly con- 
sists of a control prediction generator and a network delay and data dropout 
compensator, is proposed to overcome unknown network transmission with 
time delay and data dropout. The control prediction generator is designed to 
generate a set of future control predictions with the optimal state estimate. 
The network time delay and data dropout compensator is used to compen- 
sate for the unknown random network dropout. This networked predictive 
control system (NPCS) structure is shown in Fig. 18.11 



Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 127- fl39.| 
springerlink.com (c) Springer- Vcrlag Berlin Heidelberg 2011 
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Fig. 8.1 The networked predictive control system. 



8.2.1 System Model 

Consider a MIMO discrete system described in the following state space form 

(8.1) 



x(k + 1) = Ax{k) + Bu(k) + w(k) 
y(k) = Cx(k)+v(k) 



where x(k) £ R n , u(k) £ R m , and y(k) £ R l are the system state, input, and 
output vectors, respectively. The noise process {w(k)} is white, zero-mean, 
uncorrelated one with known covariance matrices Q%. A, B, C are matrices 
of appropriate dimensions. The reference input of the system is assumed as 
zero and the following assumptions are made. 

The arrival of the observation at time k is a binary random variable 7(fc), 
with probability distribution P( r y(k) = 1) = Afe,Afc £ (0,1) and 7(fc) is 
independent of -f(s) if k ^ s. The output noise is defined in the following 
way: 

/ N(0,Rx), 7(fc) = l 



v(k) 



\iV(0,a 2 /), 7 (fc) = 



(8.2) 



for some a 2 . 



Assumption 8.1. The pair, (A,B), is completely controllable, and the pair, 
(A, C), is completely observable. 

Assumption 8.2. The number of consecutive data dropouts must be less than 
N\ (a positive integer). 

Assumption 8.3. The upper bound of the network delay is not greater than 
N (a positive integer). 
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Some notations are defined as follows: 
Y(k) = [y(0),---Mk)] T 

r(fc) = [ 7 (o),---, 7 (fc)F 

x(k\k) =E[x(k)\Y(k),r(k)} 

P(k\k) = E[(x(k) - x(k\k))(x(k) - x(k\k)) T \Y(k), r(k)] (8.3) 

x(k + l|fc) = E[x(k + l)\Y(k), r(k)} 
P(k + ljifc) = E[(x(k + 1) - x(k + l\k)) T \Y(k), r(k)\ 
y(k + l\k) = E[y(k + l)\Y(k),r(k)] 



8.2.2 Network Delay and Data Dropout 

As we know, more and more control systems use the network to transmit 
control signals. Because the network is used in control systems, there are 
various factors introduced as a consequence of the communication network, 
such as time delay and data dropout, which are considered for ensuring the 
desired performance of the NCS. 

We assume that the measurement data y(k) from the sensor is sent to 
the controller across a network with delay and data dropout. Time delays 
and data dropout occur in a NCS due to the addition of a network. This 
delay can destabilize a system designed or can degrade the system perfor- 
mance. Network delay can be further subdivided into sensor-to-controller de- 
lay, controller-to-actuator delay, and the computational delay. In this chapter, 
the sensor-to-controller delay and controller-to-actuator delay will be consid- 
ered and the computational delay is not considered. 

The problem of network time delay over a network has been proposed 
in j^ni W^ and some types of the model have already been established. In 
this chapter, a simple approach of random time delay, which we set up as 
the Markov model for its accurate and sample is considered. To construct a 
Markov chain in discrete time, the time delay is a stochastic process with an 
upper bound N(N is a positive integer), which is a multiple of the sampling 
period of the system. 



8.2.3 The Predictive Control Scheme to Compensate 
for Time Delay and Data Dropout in the 
Forward Channel 

The Kalman Filter(KF) based state observer is designed as 



x(k\k - 1) = Ax(k - l\k - 1) + Bu(t - 1) 

x(k\k) = x(k\k - 1) + ~/(k)K(k)(y(k) - Cx(k\k - 1)) 
P(k\k) = P(k\k - 1) - 1 {k)K{k)CP{k\k - 1) 
K(k) = P(k\k - l)C T {CP(k\k - 1)C T + R)- 1 



(8.4) 
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where x(k\k — 1) € R n and u(k — 1) £ R m are the one-step ahead state 
prediction and the input of the observer at time k — 1, respectively, and 7(fc) 
indicate the signal is received or not by controller at time k. If the j(k) = 1, 
it means that the signal is received by the controller at time k, otherwise 
7(fe) = means the signal is not received. P(k\k — 1) is the solution of the 
following modified Riccati equation [169] 

P(k\k - 1) = AP(k - l\k - 2)A T + Q- j(k)AP(k - l|fc - 2)C T , , 
x (CP(k -l\k- 2)C T + R)- l CP(k -l\k- 2)A T ^ > 

The state predictions at time k are constructed as 

x(k + l\k) = Ax(k\k - 1) + Bu(k) + 1 {k)AK(k){y{k) - Cx(k\k - 1)) 
x(k + 2\k) = Ax(k + l\k) + Bu(k + l|fc) 



x(k + N\k) = Ax(k + N - l|fc) + Bu(k + N - l\k) 

(8.6) 
Assume that the controller is of the following form: 

u(k) = u{k\k) = L(k)x(k\k) (8.7) 

where L(k) £ pjnxn j s ^ e s ^ a ^ e feedback control matrix to be determined 
using modern control theory. Then, the control predictions are generated by 

u(k + t\k) =L(k)x(k + t\k), for t = 0, 1,2,- •• ,N (8.8) 

Thus, it follows from equation (|8.6p that 

x(k + t\k) = (A + BLik)) 1 - 1 ^ + l|fc) (8.9) 

Based on equations (|8.4p . (|8.6p and (J8.8I) . it can be shown that 

x(k + t\k) 
= (A + BL(fc))*- 1 [ J 4x(fc|ifc - 1) + Bu(k) + ~f(k)AK(k)(y(k)-Cx(k\k - 1))] 
= {A + BL(k)) t - 1 [(A + BL(k)-"f(k)(AK(k) 

-BL(k)K(k))C)x(k\k - 1) + j{k)(AK(k) + BL(k)K(k))Cx(k)} 

(8.10) 
and 

u(k + t\k) 
= L(k)x(k + t\k) 
= L(k)(A + BLityy-^iA + BL(k) - j(k)(AK(k) 

-BL(k)K{k))C)x(k\k - 1) + j(k)(AK (k) + BL{k)K{k))Cx{k) 



t-UtA , ur(u\ ~fu\(Atr(u\ ( 8 - n ) 



In order to compensate for the network transmission delay and data loss, a 
network delay compensator is proposed. A very important characteristic of 
the network is that it can transmit a set of data at the same time. Thus, 
it is assumed that predictive control sequence at time k is packed and sent 
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to the plant side through a network. The network delay compensator chooses 
the latest control value from the control prediction sequences available on 
the plant side. For example, if the following predictive control sequences are 
received on the plant side: 



a 



(k\k),u T (k + l\k), ■ ■ ■ , u T (k + N- l|fc), • • • , u T (k + N\k)] T (8.12) 



On the side of the actuator, u(k\k) is used as the input to the actuator. 
If a new control package containing control predictive sequences, which are 
delayed or dropped at the next step, is dropped, one step control prediction 
u{k + l\k) will be used as control input to the actuator. If the new package 
of control predictive sequences are received, then the first control input will 
be used as the input to the actuator. Otherwise, u(k + 2\k) will be used as 
input to the actuator, ... and so on. Based on the assumption, it is reasonable 
that there are at least N times consecutive time delay or data dropout. The 
stochastic stability criteria of the closed-loop networked predictive control 
systems can be analytically derived based on the methods in previous work 
|1101ll98j . In fact, using the networked predictive control scheme presented 
in this section, the control performance of the closed-loop system with delay 
and data dropout is very similar to that of the closed-loop system without 
delay and data dropout. 

8.2-4 The Optimal Estimation Method to Compensate 
for Time Delay and Data Dropout in the 
Feedback Channel 

In this part, we will propose an optimal estimation method, which is modified 
from the method presented in |166| . to overcome the time delay and data 
dropout in the feedback channel. There is a buffer to store the data from the 
sensor and the length of the buffer can be set to store the data in this step 
and before. 

We assume that the length of the buffer is set to be D, so the controller 
discards the data, which are delayed by D times or more, from the sensor. 
For example, if y(k — D) is not received by the controller before k, then 
even if y(k — D) arrives at k or at a later time, it will be discarded by the 
controller. In 18.2.31 We have given the form of the Kalman Filter, which is 
shown in (j8.4[) . Let j(k) be the indicator function for y(k) at time t,k < t. 
i.e.,7(fc) = 1 if y{k) arrives at t and j(k) = otherwise. Depending on 
whether y(k) is received or not, i.e., j(k) — 1 or 0. (x(k\k), P(k\k)) is known 
to be computed by a Kalman Filter (KF) through equation l|8.4|) . We write 
the (x(k\k),P(k\k)) in the compact form as 

(x(k\k),P(k\k)) = KF(x(k - l|fc - l),P(k - l\k - 1), i(k),y(k), u(k - 1)) 

(8.13) 
which represents the equation (j8.4|l . 
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A method to optimal the control with time delay in the feedback channel 
will be presented in this part. As y(k — i) may arrive at time k due to the 
delays introduced by the network, we can improve the control quality by 
recalculating x(k — i\k — i) utilizing the new available measurement y(k — i). 
Once x(k — i\k — i) is updated, we can update x(k — i + l\k — i + 1) in a similar 
fashion. Let y(k — i),ie [0, D — 1] be the oldest measurement received by the 
estimator at time k, then x(k\k) is computed by i + 1 KFs as 

(x(k - i\k - i), P(k - i\k - i)) 
= KF(x(k-i- l\k-i- l),P{k - i - l\k- i - l),l,y(fc - i),u(k- i - 1)) 
(x(k -i + l\k-i + l), P{k -i + l\k-i + l)) 

= KF(x(k - i\k - i),P(k - i\k - i), j(k - i + 1), y(k-i+ l),u(k - i)) 



(x(k-l\k-l),P(k-l\k-l)) 

= KF(x(k - 2|fc - 2), P(k - 2|fc - 2), 7 (fc - 1), y(k - 1), u(k - 2)) 

(x(k\k),P(k\k)) (8.14) 

= KF(x{k - l\k - l),P(k - l|fc - l),j(k),y(k),u(k - 1)) 

In order to compensate for the network transmission time delay and data 
dropout in the feedback channel, a buffer is set in the controller to store the 
new data from the sensor and recalculate the x(k — i\k — i) to get the new 
x(k\k). With the new x(k\k), the controller can give out the control signal 
u{k\k) and the predictive control sequences u(k + l|fc), • • • 7 u(k + N\k) and 
send it to the actuator through network. In the controller, if the controller 
received the new data y{k — i) at time k, where i E [0, D — 1], the controller 
will store the new data corresponding to the cell of the buffer and set the 
"f(k — i) to 1. Then the controller will find the oldest measurement stored in 
the buffer with j(k — i) = 1 and calculate the x{k\k) according to equations 
(|8.14[) . At last, the controller can calculate the predictive state sequences 
x(k + l\k),x(k + 2|/c), • • • ,x(k + N\k) according to equations (|8.6p and gets 
the predictive signal sequence u(k\k), u(k + l\k), • • ■ , u(k + N\k), which is sent 
to the actuator to control the system. After the actuator received the predic- 
tive control sequences, the compensator will choose the best control signal 
from the sequences according to the law which have been proposed in 18.2.31 
Using this method, we can compensate for the time delay and data dropout, 
which happen in the both forward and feedback channels, and optimize the 
performance of the system. 



8.3 Choose Model of System Structure 

In the MPC schemes for NCS, we use a full nonlinear model and its linearized 
model to denote the inverted pendulum, and it would be accomplished by 
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the control loop with the network simulation, in which the Markov model 
is used. 



8.3.1 Inverted Pendulum Model 



Consider a single inverted pendulum, which contains a vertical level of the 
inverted pendulum and a cart. The structure of the inverted pendulum is 
shown as Fig. 18.21 The pendulum angle, the cart position, the inverted pen- 
dulum angular velocity and the cart velocity are denoted by <f), x, <f> and i, 
respectively. 




->* 



Fig. 8.2 Structure of the linear inverted pendulum. 



We can obtain the nonlinear dynamics equations (|8.15p of the inverted 
pendulum through the mechanical analysis of the inverted pendulum. 



Table 8.1 Parameters used in the linear inverted pendulum model 



Symbol 



Value 



Meaning 



m 
M 
I 

b 
I 
9 



0.109 Kg Mass of the pendulum rod 
1.096 Kg Mass of the cart 
0.25 m Length from the pendulum axis 

to its centroid 
0.1 N/m/sec The friction coefficient of the cart 
0.0034fc<; * m* m Inertia of the rod 

9.81m/s 2 Gravitational constant 
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1. Nonlinear Model 



(M + m)x + bx + mltfi cos <fi — ml<p 2 sin </> = F 

—(1+ ml 2 )<f> + mgl sin</> = mix cost 



(8.15) 



where, F means the force, which can drive the cart moving to keep the 
pendulum rod in the vertical upward. 
2. Linear Model 

Linearize the nonlinear dynamics equations, let cos(f> = — l,sin</> = 



(l?) 2 = an d use u instead of F, we can get 



' v dt 



— (I + ml 2 )cf) + mgl<f> — mix 
(M + m)x + bx + mlcf) = u 



(8.16) 



Let X T — [x,x, i 
model: 



= — x and I = ^ml 2 , we can obtain the state-space 



X = 



"0 10 0" 




" " 


00 
00 1 


x + 


-1 




00 § 




3 

. 41 . 



.17) 



(8.18) 



By using the plant parameters of the TABLE 18.11 and discretize the system 
dynamics with the sample time 0.01s, we have 





X 




X 

A 


= 


'1000" 
00 10 




X 




+ 


"o" 












A 







X(k + 1) = A d X(k) + B d u{k) 

1 0.01 

10 

1.0015 0.01 
0.2941 1.0015 



X(k) 



-0.0001 

-0.01 

0.0002 

0.03 



*(*) 



(8.19) 



8.3.2 Random Network Time Delay Model 



As described in 18.2.21 in this chapter, the network with time delay and data 
dropout are simulated by the Markov model. Let each of states of the Markov 
chain represents the different random time delay and data dropout. According 
to the state jump in the Markov chain, the time delay of the network is 
variable. In this example, we assume a 5 states Markov chain with N — 4, 
which means that the maximum number of steps of time delay is 4 in the 
both forward and feedback channels. Thus the maximum number of steps of 
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time delay in the control loop is 8 steps and the state transition probability 
matrix of the forward and feedback channel is shown in the following: 

0.3 0.2 0.2 0.2 0.1 
0.2 0.3 0.2 0.2 0.1 

0.10.20.40.20.1 (8.20) 

0.1 0.2 0.2 0.3 0.2 
0.1 0.1 0.2 0.2 0.4 



forward — * feedback 



where P 'forward is the state transition probability matrix of the forward chan- 
nel and the P feedback is the state transition probability matrix of the feedback 
channel. 



8.3.3 Structure of the Controller 

Through the discrete LQR state feedback control law, the linearized model 
(|8.19[) could be used to derive a controller with the form 

u = -LX (8.21) 

Design a discrete LQR state feedback control law for state regulation, then 
it can be obtained by minimizing the cost function: 



/>oo 

J = (X T QX + u T Ru)dt 
Jo 



.22) 



8.4 Simulation Results 

In order to demonstrate the effectiveness of the proposed predictive control 
scheme ([8. lip and the optimal estimation method (|8.14[) in the feedback 
channel, numerical simulations have been performed and presented compar- 
ing with the control method without any compensation in this section. The 
plant is chosen as the linear inverted pendulum model (|8.17[l and the pen- 
dulum parameter values are selected in Table 18.11 This section gives the 
trajectory curves of the pendulum angle <f> and the cart position x with dif- 
ferent control methods when the pendulum angle <j> reaches stable from the 
initial state <j> = 0.2 (X = [0 0.2 0]'). 



8. 4-1 Control the Inverted Pendulum without Network 

Consider the model of the inverted pendulum (|8.19|) and LQR state feedback 
control law (|8.2ip without data dropouts and noises. The parameters in cost 
function (|8.22p are selected as 
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Q 



1000 





0" 

















500 















R = l 



.23) 



which yields the feedback gain 

L = [-31.6228 - 20.8404 - 77.0990 - 13.6080] 



.24) 



The trajectory of the pendulum angle reaches at zero from the initial posi- 
tion and keeps the pendulum stability. The trajectory of the cart position is 
depicted in Fig. 18.31 which indicates that, without networks, the pendulum 
stability can be guaranteed under the LQR state feedback control law. 
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Fig. 8.3 Control the inverted pendulum without network. 



From Fig. 18.31 we can see that the cart position and the pendulum angle 
reach stability before k = 600 and the overshoot of the pendulum angle is 
smaller than 0.1. The curve of the cart position shows that the cart doesn't 
leave far away from the center position x = 0, which tells us that the perfor- 
mance of the system is good when the controller control the pendulum and 
keep it stable. 



8-4-2 Control the Inverted Pendulum through 

Network without Compensation of the Time 
Delay and Data Dropout 

In this part, we will consider the NCSs with time delay and data dropouts. 
In order to construct a NCS with random time delay and packet loss, which 
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is depicted by Markov chains, the transition probability matrix is selected as 
the Markov model (I8.20p . System performances of the control without any 
compensation are shown when the time delay and data dropout happen in 
both the forward and feedback channels. 

The method of controlling the system without any compensation means 
that if the signals of control and feedback, which are transited through net- 
work, are delayed or discarded when the network is busy, the actuator will 
give out a zero signal to control the plant. Because of the time delay and data 
dropout, the closed-loop system will become the open-loop system and the 
performances of the system will be worse than the system without network. 
As Fig. 18.41 shown, we can see that the curves of the pendulum angle and 
cart position are divergence because time delay and data dropout are bad for 
the performances of the system. Time delay and data dropout are added to 
the channel of the transition, which will lead the inverted pendulum out of 
control. 




D 100 2D0 300 400 500 600 700 B00 900 1000 



Fig. 8.4 Control the inverted pendulum through network without compensation. 

8-4-3 Predictive Control Scheme and Optimal 
Estimation Method for NCSs 

In the following, we firstly consider that only the predictive control is ap- 
plied in the NCSs. Fig. I8.5I shows the curves of the pendulum angle and cart 
position with predictive control used to compensate for the time delay and 
data dropout. From the figure, we can get that the pendulum angle is well 
stabilized in the equilibrium position when there are time delay and data 
dropout in both forward and feedback channels. Compared with Fig. l8.4l the 
pendulum angle and the cart position are stable at the position of equilibrium 



138 



Networked Control of Systems with Predictive Compensator 



in Fig. 18.31 although the curve of the cart position has larger overshoot and 
the time delay and data dropout happen in both the forward and feedback 
channels with network. Because the predictive control is introduced to control 
the system, the pendulum angle can be stabilized in the vertical position but 
the performance of the system is not good and the cart position is far away 
from the center position shown as Fig. 18.41 and Fig. 18.51 

Fig. 18.61 shows the curve of the pendulum angle and the cart position with 
predictive control and optimal estimation. As we expect, the performance 
of the system is improved after introducing both the predictive control and 
optimal estimation method to the controller. Compared Fig. l8.6l with Fig. 18.51 
it is obvious that the curve of cart position in Fig. 18.61 has smaller overshoot 
and settling time than the one in Fig. 18.51 




Fig. 8.5 Control the inverted pendulum through network with predictive control. 



The control behavior of LQR state feedback control with network and 
without network have been shown, and we have also discussed the control 
behavior of the predictive control and optimal estimation method in the 
front of this part. In this simulation, the predictive control can guarantee 
the stability of inverted pendulum system with time delay and data dropout 
while the system is unstable without any compensation for the time delay 
and data dropout. Both the predictive control and optimal estimation method 
are introduced into the controller, which can not only guarantee the inverted 
pendulum system stable but also the curve of the cart position with smaller 
overshoot. In this part, the result of the simulation shows that the predictive 
control and optimal estimation method can compensate for the time delay 
and data dropout in the network and improve the performance of the NCSs. 
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Fig. 8.6 Control the inverted pendulum through network with predictive control 
and optimal estimation. 



8.5 Summary 



A new networked predictive control scheme and an optimal estimation 
method, which is based on the Kalman filter, have been proposed for MIMO 
networked distributed control systems with random network time delay and 
data dropout. The controller uses the optimal estimate to compute a set of 
future control predictions satisfying the system performance requirements. 
The compensator chooses the best control signal to compensate for the ran- 
dom network transmission time delay and packet loss. Simulation results have 
been presented to illustrate the effectiveness of the proposed predictive con- 
trol and the optimal estimation method based on Kalman filter strategy via 
comparing with the control scheme without any compensation. 



Part IV 
Fault Detection over Networks 



Chapter 9 

Robust Fault Detection of Systems 

over Networks with Packet Loss 



9.1 Introduction 

It is clear that fault diagnosis (including fault detection and isolation, FDI) 
has been becoming an important subject in modern control theory and prac- 
tice. Since the beginning of 1970s, research in fault diagnosis has been gaining 
increasing consideration world-wide in both theory and application [1341 147| . 
This development was mainly stimulated by the trend of automation towards 
more complexity and the growing demand for higher availability and secu- 
rity of control systems. However, a strong impetus also comes from the side 
of modern control theory estimation and parameter identification that have 
been made feasible by the spectacular progresses of computer technology |26 a . 
Generally speaking, a fault detection (FD) process is to construct a residual 
signal which can then be compared with a predefined threshold. When the 
residual signal exceeds the threshold, the fault is detected and an alarm 
is generated [26j [38] . During last three decades, many methods have been 
proposed, for example: Clark, and co-workers proposed observer-based FDI 
approach [31] and the parity relation schemes for FDI were later developed 
by Mironovski [120) . Leininger [55] pointed out the impact of modeling errors 
on FDI performance. The first attempt of improving robustness of observer- 
based FDI approaches is attributed to Frank and Keller 48 . It should be 
pointed out that, in all the aforementioned schemes, it has been implicitly 
assumed that data transmission is without time delay and packet loss. Since 
network cables are involved in control systems in today's world, a seemingly 
natural problem is to study FDI problems for networked control systems 
(NCSs) in the presence of network-induced delays or with data packet loss 
[68l 11931 11491 11981 [To] . Fang et al [44] proposed an overview of main ideas 
and results on fault diagnosis of NCSs, including the fundamentals of fault 
diagnosis for NCSs with information scheduling, fault diagnosis approaches 
based on the simplified time-delay system models, and the quasi T-S fuzzy 
model and fault diagnosis for linear and nonlinear NCSs with long delay. 

Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 143- [l58.| 
springerlink.com (c) Springer- Vcrlag Berlin Heidelberg 2011 
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However, in the most of the aforementioned methods, it is assumed that 
the fault detection center is located at the same node with the controller. 
In this chapter, we focus our attention on a more general case that the FD 
center is neither located at the controller node nor located at the plant node, 
all the input data and measurement data is transmitted from the actuator 
node and the sensor node to the FD center, respectively, over unreliable 
networks with bounded packet loss. The bounded packet loss is modeled in 
two ways: arbitrary packet loss process and Markovian packet loss process. 
The stability analysis of the error system and the design of fault detection 
filter (FDF) gains are also given to satisfy some performance constraints. 

The rest of this chapter is organized as follows. In Section 19.21 the FD 
model taking into account the packet transmission loss and main assump- 
tions are presented. The stability analysis and FDF design are given, which 
satisfies the given constraits in Section 19.31 In Section 19.41 the FD algorithm 
is proposed according to the trade-off design of robustness and sensitivity. 
An illustrative example is presented in Section 19.51 to show the effectiveness 
of the result. The chapter is concluded in Section [ 



9.2 Description of Fault Detection over Networks 

Consider a monitored system described by 

x{t) = A c x(t) + B c u{t) + E dc d(t) + E fc f(t) , , 

y(t) = C c x(t) [JA) 

where x £ R™, u £ MP and y £ M. m are the system's state, reference inputs 
and measurements, respectively d £ R" d and / £ M. n f are disturbance and 
the latent fault in the system. Matrices A c , B c , C c , E dc , and Ef c are of ap- 
propriate dimensions. For data acquisition, it is supposed that the sensor and 
the actuator are time-driven with an constant sampling period h. Discretiza- 
tion of the monitored system (|9.ip according to the sampling period h will 
then give 

x(k + 1) = Ax(k) + Bu{k) + E d d(k) + E f f(k) 



y(k) = Cx(k) 



where 



A = e A ' h , C = C C , B= f e A " s B c ds, 

Jo 

E d = e A ' s E dc ds, E f = e A ' s E fc ds 



Remark 9.1. The monitored system is shown in Fig. 19.11 the inputs and out- 
puts of the plant are uu(t) and yn{t), respectively. However, Ujj(t) are not 



9.2 Description of Fault Detection over Networks 



145 



available for measurement, we have to use the reference command u(k) and 
the measured output y(k) in FDI. Hence, the model of the monitored system 
involves the actuator and the sensor additionally. 



u(k) 



local controller 



y(k) 



« g (0 



plant 



y*(0 



monitored system 



network 



networked controller 



FD center 



Fig. 9.1 The structure of FD over networks. 



The structure of fault detection over networks discussed in this chapter is 
shown in Fig. 19.11 The inputs of monitored system, u(k), and the measure- 
ments of the monitored system, y(k), are transmitted to the FD center node 
from the actuator and the sensor in a single packet at each time step with- 
out time delay, respectively. However, the networks are not reliable, the data 
packets may be lost during the transmission. Note that the structure con- 
sidered in this chapter is not as same as structures in most literature, this 
structure is a more general case, namely, the fault detection center is located 
neither at the controller node nor plant node, and the controller considered 
in this structure is also not limited in topology. Some researchers focus on 
the scheme that the controller is remote, and fault detection center is with 
the remote controller at a same network node. On the other side, local con- 
trollers is generally used in distributed control systems (DCS). For exanrple, 
in most thermal power plant DCS, every controlled object is with a local sta- 
bilizing controller, which ensures the plant stable. This plant-controller pair 
is called subsystem. The entire system of controllers and objects is connected 
by networks to a center node for communication and monitoring. The fault 
detection algorithm can be applied in this center to diagnose the latent faults 
of every subsystem. The aforementioned two schemes are special cases of the 
structure considered in this chapter. 

We define A& = {0, 1} for data packets transmitted from the actuator to 
the FDI node at time instant k, if the FDI node receives the data packet 
successfully, then A& = 1, if the data packet losses, then A& = 0. Similarly, 
We define jk = {0, 1} for data packets transmitted from the sensor to the 
FDI node in the same way. Let F = {i\ 1, 2, 3, • ■ ■} denote the sequence of time 
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points of successful data transmission from the sensor to the FDI node. We 
define a function g(x), x <E {fc|7fe = 1} 

k 

3=0 



which denotes the map from index k to the index i, see Fig. 19.21 The following 
concept and mathematical models are introduced to capture the nature of 
packet losses. 

Definition 9.2. Packet-loss process is defined as 

{A^-^ + l)-.?- 1 ^)} (9.4) 

where <7 _1 (-) denotes the inverse function of g(-), which takes values in the 
finite state space N = {1, 2, • • • , s}. Note that the N(i) is duration between 
two successful transmissions. 



Definition 9.3. Packet-loss process (|9.4|l is said to be arbitrary if it take 
values in N arbitrarily. 



Definition 9.4. Packet-loss process ()9.4|) is said to be Markovian if it is a 
discrete-time homogeneous Markov chain on a complete probability space 
(J2, N, P), and takes values in N with known transition probability matrix 
i7 = (7ry) £M SXS , where 

Try 4 p r (N t+1 = j\Ni = i) > (9.5) 

for all i,j G N, and X^=i ^ij = 1 f° r cac h « G N. 

We further impose an assumption on the design as follows: 

Assumption 9.1. The data from the controller to each actuator are re- 
stricted to belong to a small and fixed finite set of scalars U. 

Remark 9.5. The information used for FDI in this chapter is the measured 
outputs from sensor and the inputs to the actuators. The case that the con- 
troller is placed at the plant's node is same as the case that the controller is 
placed at another node which is connected with networks. 

The principle of model-based FD is to reconstruct the outputs of the moni- 
tored system and compare them with real measurements (38j . Therefore, only 
the time instants when new measurement data packets arrive are of concern. 
Let u(k) and y(k) denote the data available at the FDI node: 

u(k) = Afeu(fc) (9.6) 

y(k) = lk y{k) (9.7) 
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index k 
index i 
Fig. 9.2 Double index. 



-'(i-l)-l g-'tf-l) g^(i-l)+l g\i)-l g~\i) 

■* 1 l l *- 



i-1 



Therefore, system (|9.2[) can be rewritten as 



sc(t + 1) = A(t>(i) + B(i)U{i) + B{i)U{i) + E d (i)d(i) + E f (i)f(i) 
y(i) = Cx(i) 



where 



A(i) =/'eA = {AAA* 4 A N H e N} 



(9.8) 
(9.9) 



B{i)= [A N ^B A N *- 2 B ••• B] 



B 



(i) = B(i) frfiafi({A ff -i W A ff -i( i ) +1 ,---,A ff -i( i+1 )_i}(g)/J (9.10) 



£,(*) = A^- 1 ^/, £„(i) = A N >- l E d 



U(i) = 



"(ff- 1 ^)) 
uig-^i + l)-!) 



,u(i) = 



u^-^i+l)-!) 



where A& = 1 — Afc and J p G C pxp is a unit matrix. 

Remark 9.6. f(i) and d(i) are not the sampled value of fault signal f(t) and 
noise signal d(t) at time instant i. According to Chen and Francis [27], the 
inter-sample behavior of d(t) and f(t) is omitted in the system described by 
equation (|9.8p . the virtual signals f(i) and d(i) are equivalent to the effect of 
real signals, they have a relation as follows: 



Ni-l 



1=0 
Ni-l 

A N *- 1 E d d(i)= ]T d{g- x {i) + l) 



(9.11) 
(9.12) 



1=0 
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Note that, the vector B(i)U(i) is unknown for the FD center, but this term 
can be regarded as a random disturbance according to Assumption 19. 11 thus 
we rewrite system (|9.8|) as 



x(i + 1) = A(i)x(i) + B{i)U{i) + B m (i)cu m (i) + E f {i)f(i) 
y(i) = Cx(i) 



(9.13) 



where 

B m (i) = [I E d {i)], u m {i) = [U T (i)B T (i) F^Y (9.14) 

we can also rewrite system (|9.8|) as 



x(i + 1) - A(i)x(i) + B{i)U{i) + B a {i)tu a (i) + E f (i)f(i) 
y(i) = Cx(i) 



(9.15) 



where 



B a (i) = [B(i) E d (i)} (9.16) 

w (») = [U T (t) F{i)] T (9.17) 



Remark 9. 7. If system ()9.ip is with the Markovian packet-loss process (|9.4|) , 
the parameter matrix A(i) = A Ni e A = {Ai|Ai = A Ni } and B m {i) are 
Markovian jump matrices [32], |210j . Meanwhile, if system (19.11) is with the 
arbitrary packet-loss process (J9.4I) . the parameter matrices A(i) and B a (i) 
are arbitrary matrices. For a measurements transmission mode i, there are 
J2h=o^i submodes for inputs transmission, so B a (i) has ELiELo^? 
modes totally in system ()9.15[) . where A\ denotes the permutation of h ele- 
ments in i elements. 



9.3 Observer Based Residual Generation and 
Evaluation 

In this section, a fault detection filter (FDF) will be designed to achieve 
residual generation and evaluation over networks with bounded packet loses. 
The FDF to be designed is 

x(i + 1) = A(i)x(i) + B{i)U{i) + K(i) (y(i) - Cx(i)) 
r(i) =L(y(i)-Cx(i)) ^^ 

where x{i) is the estimate of the state x(i), r(i) is residual, and K(i), L are 
design parameters matrices. In this chapter, the FDF gain K(i) is designed 
to be time variant, and the matrix L is the risidual weighting factor which, 
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in this chapter, is static. Let the state estimation error e(i) = x(i) — x{i) and 
the residual r(i) propagate as 

p . { e(i + 1) = {Aii) - K(i)C) e(i) + B a (i)u, a (i) + E f (i)f(i) 
a ' \ r(i) — LCe(i) 

or 

p : (e(i + l) = (A(i)-K(i)C)e(i) + B m (i)u Jm (i) + E f (i)f(i) 
m ' \ r(i) — LCe(i) 

In order to guarantee a satisfactory FD performance, K(i) and L should be 
designed such that the residual r(i) is sensitive to the fault f(i) and robust 
to disturbance co a (i) or u) m (i). 

Rest of the aim of the chapter is then to design the FDF parameters 
satisfying the constrains as: 

CI: For the monitored system (J9.1D with arbitrary packet-loss process (|9.4|) . 
the iioo-norm of system P a is less than a prescribed scalar 7 > 0, namely: 

||P.||oo:= sup sup ^^<7 (9.21) 

NiGNO^aEh ll r l|2 

C2: For the monitored system (|9.ip with Markovian packet-loss process 
(|9.4|) . the i/oo-norm of system P m is less than a prescribed scalar 7 > 0, 
namely: 

II t-» II K*^d 2 / r. ~~\ 

||Pm||oo := sup sup " " < 7 (9.22) 



C3: For the monitored system (|9.ip with arbitrary packet-loss process (|9.4[) 
or with Markovian packet-loss process (|9.4p . the 7J_-norm of system P a or 
system P m is greater than a prescribed scalar (3 > 0, namely: 

||P ||_(||P m ||_) := inf |4 i >/3 (9-23) 

NiGN \\r\\2 

9.3.1 FDF Stability Analysis with Packet Loss 

In this subsections, we analyze the stability property of the FDF. For the 
monitored system (I9.1[) with the arbitrary packet-loss process (|9.4[) . a suffi- 
cient condition is derived by adopting a packet-loss dependent Lyapunov func- 
tion approach. For the monitored system (|9.ip with the Markovian packet-loss 
process (19.41) , a necessary and sufficient condition is established by using the 
theory from Markovian jump systems. The conditions are given in terms of 
LMIs. 

Definition 9.8. Let e(l;eo) be the trajectory of system (|9.19[) with initial 
state eo- System (19.191) with arbitrary packet-loss process (|9.4p is said to be 
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stable if for any e > there exists a S = 6(e) > such that || e ||< S implies 
|| e(l; eo) ||< e for I £ Z + . Furthermore, it is said to be asymptotically stable 
if it is stable and lim^oc || e(l; eo) || 2 = for any initial state eo £ M. n . 

Theorem 9.9. System J9.19]) with arbitrary packet-loss process asymptoti- 
cally stable if there exist matrices Pi £ S + , i EN, such that 

(A 3 - K 3 C) T Pj (A 3 - K 3 C) -P t <0 (9.24) 

holds for all i,j £ N, where Aj £ A. 

Proof. The initial state of system (j9~19|) is e(l) = (A(0) - K(0)C)e , and let 
i = Ni—i, j = Ni, we take the packet-loss Lyapunov function as 

V(i) = e T (i)P {g -i i:l) _ g -i {t _ 1)} e(i) = e T (i)P z e(i), (9.25) 

so we have 

V(i + 1) = e T (i)(A j - KjCfPjiAj - K 3 C)e(i) (9.26) 

Therefor, V(i + 1) - V(i) < for any e(i) ^ if inequality (|9~2"4]) holds. 
Hence, lim^oo V(i) = 0. 

Furthermore, let ft = max; gW ||P;||, ft = m nugNJl/HPf 1 !!}, ft = 
max{max; e N ||^ — ^C|| 2 , 1}, and /3 = a/ (ft ft) /ft- Then given any e < 0, 
we prove that ||eo|| < ft implies ||e(Z, eo)|| < e for I £ Z + in the following. 

For Z > 1, we have ft||e(Z, eo)|| 2 < V(l) according to the definition of Lya- 
p unov functi on, and V(l) < V(l ) < ft||e(l)|| 2 < ftft||e || 2 . So ||e(Z,e )|| < 
V / (ftft)/ft||e || < ^(ftftVftft < £• Thus we conclude that ||e(Z,e )|| < e 
for all I £ Z + if ||eo|| < 5 with <5 — ft. According to Definition 19.81 system 
(|9.19[) is asymptotically stable. 

Definition 9.10. System (|9.20|) with Markovian packet-loss process ()9.4p is 
said to be mean square stable if linn^oo £7( 1 1 e (Z , eo ) || 2 ) = for any initial 

state e £ R" 

Theorem 9.11. System \9.20\) with Markovian packet-loss process \9.^\) is 
mean square stable if, and only if, there exist matrices Pi £ S + , i £N, such 
that 

s 

J2 N (Aj - K,C) T P 3 (A 3 - K 3 C)\ -P t <0 (9.27) 

3=1 

holds for all i £ N. 

Proof. (Sufficiency) Because {Ni : i £ N} is a discrete-time homogeneous 
Markov chain, system (|9.20|) is a discrete-time Markovian jump linear system 
with s operation modes. Now take a Lyapunov function as follows: 

V(i) = e T (i)P {g - Hi) _ g - Hi _ 1)) e(i) = e T (i)P t e(i) (9.28) 
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we have 



E(V(i + l\N i - 1 =i)-V(i)) 



= e T {i) ( Y^iMo ~ K,C) T P 3 (A, ~ K 3 C)] - P t ] e T « < 



for any e(i) ^ if inequality (|9.27j) holds. Hence, lim^oo E(V(i)) = and 
lim^oo -B(||e(i; e(l))|| 2 ) = 0. That is, system (|9.20[) is mean square stable. 

(Necessity) Suppose system (|9.20[) is mean square stable. Because system 
(J9.20I) is a Markovian jump system, according to the stability results from 
Markovian jump systems, there exist matrices P, £ § + , i £ N, such that 
(P9~27l) holds. 



9.3.2 Robust Design of FDF 



With the stability results developed in subsection l9.3.1l the robust FDF de- 
sign techniques are provided in this subsection. We introduce two lemmas as 
follows 



Lemma 9.12. For a given scalar 7 > and a system as follows: 



P: 



x(k + 1) = Ag k x(k) + B^ k u(k) 
z(k) = Cx(k) + Duj(k) 



(9.29) 



where 9k G Ni = {1, 2, • • • , si} and <pk G N2 = {1, 2, • • • , S2}, the following 
conditions are equivalent: 



(i) system P is asymptotically stable and the Hoo-norm denoted as 

klla 



\P\\ 



sup 



sup 



flo6Ni,0oeN 2 O#wGZ2 1Mb 



(9.30) 



satisfies ||P||oo < 7- 

(ii) there exist matrices Pij > 0, Vi G Ni, Vj G N2 i/iai satisfy 



<0 



"A,; S/ 


T 


[p« 0" 




\ABf 




\Ph 9 1 


C D 




/ 




C D 




L ° t 2/ J 



(9.31) 



(Hi) there exist matrices P^ > and Gij , Vi G Ni, Vj G N2 i/iai satisfy 



C D 



Gij + Gij - Pij 



CrijAi Lrij-Dj 

C D 



Phg 

7 2 / 



<0 
(9.32) 



Proof, (ii) <=> (i). If there exist matrices P^ > such that inequality (|9.3ip 
holds, so there exist a proper scalar e, < e < 1 such that 
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T 



Phg 

(l-e) 7 2 / 



> 



AiBj 
C D 



PyO 

/ 



A i B j 
C D 



holds. According to inequality (|9.3ip . we have 



P hg - Aj P %] A > 



so, system (|9.29|) is asymptotically stable, and 

V(k) = x T (k)Px(k) 



(9.33) 



(9.34) 



(9.35) 



is a Lyapunov function of system (|9.29p . Now we prove that 7 2 |M| 2 is an 
upper bound of ||z|||, consider a function: 



j fe = ||z|| 2 -(i- e ) 7 2 IM| 2 . 

Let AV(k) = V(k + 1) - V(k), we have 



(9.36) 



Jk=[\\z\\ 2 -(l-eh 2 \\oj\\ 2 + AV(k)} 

-AV(k) 

'Phg 

(l-e) 7 2 / 
's(fc)~ 



x(k) 



[C D] T [C D] 



\-[Ai BjYP^A, B j 
-AV(k) 



Lj{k) 



~x(k)~ 
u(k) 


'( 


' a % b; 

C D 


T 


~Pii o" 

I 




'AiBj- 
C D 


- 



Phg 

(l-e)7 2 / 
-AV{k) 

According to inequality (|9.33[) . we have Jfc < — AV(k), that is 

\\z(k)f<(l-e)j 2 \\ojf-AV(k) 



x(k) 
u>(k) 



(9.37) 



sum both side of inequality (|9.37|) from k — to k — n, since the disturbance 
w(k) € li., we have 



(9.38) 
(9.39) 



£ ||z(fc)|| 2 < (1 - 6) 7 2 E ll w ( fc )H 2 - V ( n + !) 

fc=0 fe=0 

<(l-e)7 2 |k(fc)|| 2 -^(n + l), 
because of linin^oo x(n) — 0, we have 

\\z(k)\\l<(l-e)^\\Lo\\l<^Ml (9.40) 
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(ii)— ► (iii). We choose G^- = G^ = Pij, that is (ii) implies (iii). 
(iii)— > (ii). By Schur compcmcnt, an LMI can be obtained from (iii) as 
follows 

" -P hn AjGl C T ~ 



h g 

- 7 2 / 
GijAi GijBj Pij — &ij — Gy- 



B I G ij 







c 











<0 



(9.41) 



and pre-multiplying and post-multiplying [/ A\ and its transpose to (|9.41[) 
will yield (ii), where 



.4 



AtBj 
C D 



Lemma 9.13. \149j For a given scalar 7 > and a system as follows: 

( x(k + 1) = A 9k x(k) + Bg k Lj(k) . . 

' { z{k) = Cx{k) + Du{k) l ' 

where ^eN = {1, 2, • • • , s\ and we define that 7Tjj = Pr{9k+i = j\9k = *} — 
is Markovian jump probability, the following conditions are equivalent: 



(i) system \9.4%fy is square stable and the H^-norm denoted as 



\P\\ 



sup 



sup 






(9.43) 



satisfies \\P\\oo < 7. 

(ii) there exist matrices Pi > t/iaf satisfy 



\A % B % ' 


T 


\PiO~ 




\AiBi 




\Pi ] 


C D 




/ 




C D 




7 2 / 



<0 



(9.44) 



where Pi = X^=i ^u'-fj an( ^ * = #fc <= N 

(ra,) i/iere ea;isi matrices Pi > and G^ i/iai satisfy 



GiAi GiBi 
C D 



Gi + Gf-PiO 
J 



GiAi GiBi 
C D 



Pi 

7 2 / 



< (9.45) 



where Pi — Y] ■_ 1 i^ijPj and i — 6k G N 



Based on Lemma f9. 121 and Lemma f9. 131 two theorems can be obtained easily 
to design the FDF gain as follows: 



Theorem 9.14. For given scalar^/ > 0, if there exist matrices P^ 
Gij and Yij , V« S N,j € N/ such that 



Pi > 0, 
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-Phg 







-1 2 I 



% ^ij ^ ij ^ 

B aj G Tj ° 

(-rijAi — YijC CijB a j Pij — Crij — Gjj- 

LC -I 



<0 



(9.46) 



where Kij — G i7 - Yij, then system A9.19)) with arbitrary packet-loss process 
\9.4\j is asymptotically stable and ensures the constraint CI. 



Proof. If there exist matrices Pij = P? > 0, Gy and Yy = GijKij such that 
LMI (j9^46|) holds, we obtain 



-Phg 






-1 2 I 




B I G ij 




C T 




GijAi 


GijBj 


P ■ 


- Gij - 


G H 





C 












-I 



<0 



(9.47) 



where A+ = Ai — KijC, Bj — B a j and C = LC. By Schur complement, we 
obtain that (|9"17|) implies f02]) . Hence, the FDF gain K tj = G" 1 !^ ensures 
system (I9.19[) asymptotically stable and the constraint CI. 

Theorem 9.15. For given scalar 7 > 0, if there exist matrices Pi = Pf > 0, 
Gi and Yi, Vi € N,j <E N/ suc/i that 



-P, Af Gf - C T Y? C T L T 

- 7 2 / _ Blfi? t 

Gi-Aj — YiC CriB mi Pi — (ji — Gj 

LC 0-7 



<0 



(9.48) 



where Pi = Xw=i n ijPj an< ^ ^-i = Gi Yi, then system J9.20)) with Markovian 
packet-loss process j9.4\l is square stable and ensures the constraint C2. 



Proof. If there exist matrices Pi — P 4 T > 0, Gi and Yi — GiKi such that LMI 
(|9.48|) holds, we obtain 



-P AJGJ C T 

0_ -7 2 J P T Gf 

G^i G,P Pi -Gi-Gf 
GO 0-7 



<0 



(9.49) 



where Ai = Ai — KiC, B = B mi , C = LC and Pi = J2j=i n ijPj- By Schur 
complement, we obtain that (19.49[) implies (19.45[) . Hence, the FDF gain K^ = 
G~j~j Yj,j ensures system (|9.20[) asymptotically stable and the constraint C2. 



Remark 9.16. In Theorem 19.141 we can substitute a positive matrix P, a 
symmetric matrix G and a matrix Y for the positive matrices Pij , symmetric 
matrices Gy and matrices Yy , respectively, then a conservative FDF gain is 
given by K = G~ 1 Y. Same result can be obtained in Theorem 19. 151 
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9. 3. 3 Sensitivity Constraint of FDF 

First, we look at the minimum (i.e., worst-case) fault sensitivity requirement: 



|Pa||-(||Pm||-) 



h.r ft>/3, 



(9.50) 



w,gn ||r|| 2 

similarly, we have the following two lemmas from Lemma 19.121 

Lemma 9.17. For a given scalar (3 > and an asymptotically stable system 
as follows: 

' x{k + l) =A 9h x{k)+B 6 J{k) 
z{k) =Cx(k) + Df(k) 

where 0). 6 N = {1, 2, • • • , s}, the following conditions are equivalent: 
(i) the H- -index of system {9.5$ denoted as 

1/112 



(9.51) 



|P||_ = inf 



9fc£N ||Z|| 2 



(9.52) 



satisfies ||P||_ > (3. 

(ii) there exist symmetric matrices Pi that satisfy 



\AiBi~ 


T 


\Pi o " 




\AiBi~ 




C D 




-I 




C D 





Pj 

o -p 2 i 



<0 



(9.53) 



where i = ^ e N. 

Lemma 9.18. For a given scalar (3 > and a square stable system as follows: 



P 



x{k + l) =A 0k x(k)+Bg k f(k) 
z(k) = Cx(k) + Df(k) 



(9.54) 



where Ok € N = {1, 2, • • • , s} and we define that 7Tjj = Pr{6k+\ = j\9k = i} > 
is Markovian jump probability, the following conditions are equivalent: 



(i) the H_-index of the system \9.5J$ denoted 



as 



|P||_ = inf 



l/lb 



SfcGN Z 2 



(9.55) 



satisfies \\P\\- > (3. 

(ii) there exist symmetric matrices Pi that satisfy 



\AiBi 


T 


\Pi o " 




\Ai B t ~ 




\Pi 





C D 




-/ 




C D 







-(3 2 I _ 



<0 
u J L u ~P~ X 

where Pi — X) 7 =i ^ijPj an d i = Ok ^ N. 

Proof. The proofs of these Lemmas are similar to Lemma 19.121 



(9.56) 
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9.4 Fault Detection Algorithm Design 

According to Chen and Patton 26J, the combined constraints C1/C2 with 
C3 such as in the way of 

\\^A_ >a2 

\\G r f\\oo 

can, of course, be chosen and this combination also makes sense. However, 
this is not recommended. The reason are as follows. First, the problem for- 
mulation in C1/C2 has clear physical meaning. The constraints C1/C2 and 
C3 provide directly quantitative measures for robustness and sensitivity of 
a fault detection observer. The value 7 is very useful for threshold selection 
in detection decision-making. The ratio fl/'y indicates how good a designed 
fault detection observer is and therefore can be used for evaluation of fault 
detection observers. Secondly, the present problem formulation enables the 
direct time-domain solution of the robust fault detection observer problem 
by using the LMI approach. Finally, as will be shown, the robust fault detec- 
tion is equivalent to a constrained H^ estimation problem, the latter can be 
further reformulated as standard problem of constrained optimization, thus 
we give the following algorithms: 

Algorithm 9.1. Given a scalar (3, the search problem of the lowest possible 
value of 7 and make system i9.1\) with arbitrary packet-loss process \9.4\j 
asymptotically stable can be formulated as the following convex optimization 
problem: 

min 7 s.t. LMI §9~Jh} fi9~5Hi (9.57) 

which can be effectively solved by the existing Matlab LMI toolbox \5$ . 

Algorithm 9.2. Given a scalar [3, the search problem of the lowest possible 
value of 7 and make system \9.1\) with Markovian packet-loss process \9.4\j 
square stable can be formulated as the following convex optimization problem: 

min 7 s.t. LMI ( gggj (f^TSj) (9.58) 

which can be effectively solved by the existing Matlab LMI toolbox \5$ . 

9.5 Numerical Example and Simulations 

In this section, in order to validate the proposed method, a servo motor 



control system [110] that consists of a DC motor, load plate, speed, and 
angle sensors is considered. The model of the motor control plant at sampling 
period h = 0.04s was identified to be 

„. _!, O.O54O90- 2 + 0.115z- 3 + 0.001z- 4 . . 

G(Z > = l-1.12z-i-0.213z-' + 0.335z-3 (9 ' 59) 
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The system can also be written as the state space form with the following 
system matrices 



.12 0.213 


-0.335 




1 


1 





,B = 





1 











, Er = Ed 



1 00 
10 
001 



C* = [0.05410.1150 0.0001 
The state feedback matrix Ku is designed to be 



Ku 



0.027 0.575 0.0001 



which ensures that the close-loop system is stable. A state jump fault 

/(*) = 



occurs when k > 60, and the disturbance d{k) is assumed to be white noise, 
d(k) £ N(0, 0.1). The outputs of controller u(k) and the measurements from 
sensor y(k) are transmitted to the FD center over networks with packet loss. 
For arbitrary packet loss process simulation, we assume that packet loss is a 
random process, and let (3 = 10, and weighting matrix L = 0.001 [100 50 5000], 
then the optimal value of 7 is 7* = 1.8177, thus the conservative filter gain 



20 40 



100 120 140 160 180 200 




Fig. 9.3 The simulation results of proposed methods in arbitrary packet loss pro- 
cess situation. 
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is designed to be K = [8.4400 8.1843 7.5937] T , Fig. |9~31 shows the results of 
this simulation. 

For Markovian packet loss process simulation, we assume that the transi- 
tion probability matrix 

"0.6 0.3 0.1" 
77 = 0.8 0.10.1 
0.70.20.1 

and let (3 = 10, then the optimal value of 7 is 7* = 2.5310, thus the filter gain 
is designed to be K x = [7.4890 6.3995 5.6861] T , K 2 = [8.0768 7.7909 6.1123] T , 
K 2 = [0.1791 0.3511 -0.0415] T . Fig. WM shows the results of this simulation. 



■ measurements y(k) 



20 40 60 80 100 120 140 160 180 200 




20 40 60 80 100 120 140 160 180 200 




20 40 60 



100 120 140 160 180 200 



time instant k 



Fig. 9.4 The simulation results of proposed methods in Markovian packet loss 
process situation. 



9.6 Summary 



A problem of fault detection over unreliable networks is considered in this 
chapter, the missing data of actuator is treated as noise, and the fault de- 
tection filter updates at every time instant when the measurements arrive at 
the fault detection center successfully. The stability analysis and filter gain 
design method are proposed, a numerical example is also given to illustrate 
the proposed scheme. 



Chapter 10 

Fault Detection over Networks Subject 

to Delay and Clock Asynchronism 



10.1 Introduction 

The research of fault detection (FD) stems from its practical application to 
a variety of industries such as aerospace, energy systems, and process control 
to name a few. The main function of a FD scheme is to detect a fault when 
it happens, which may then be acted on by sending alarm signals, taking 
protection measures, or reconfiguring a running control scheme |135) |176j . 



The observer based FD scheme is currently receiving much attention |227j . 
Generally speaking, an observer based FD system consists of an observer 
based residual generator and a residual evaluator. It is the state of the art 
that problems related to the observer based FD system design are mainly 
addressed in the context of improving system robustness against unknown 
disturbances and simultaneously enhancing system sensitivity to faults. Study 
on solving such problems builds the recent research which focus on designing 
observer based FD systems [59] , [E2] ■ 

Networked control system (NCS) has many advantages over a traditional 
point-to-point control system includes low cost of installation, ease of main- 
tenance, low cost and greater flexibility. For these reasons the networked 
control architecture has been already used many applications, particularly 
where weight and volume are of consideration, for example in automobiles 
and aircraft [198] . [110] . [108] . However, there are many fundamental ques- 
tions regarding stable operation of an interconnected hard real-time system, 
such as signal coding and control information flow, peer-to-peer networking, 
effects of the network on the performance of the system, etc. Different con- 
trol methods for NCS have been reported (see, for example, |232j . [8"U] . |186| ). 
The network-induced time delay and data packet dropout cannot be ignored 
in fault detection and isolation [231| . There are some important achieve- 
ments in the fault detection and isolation (FDI) for NCS (see, for example, 
[192] . [59] . [68]). The theory and practice of fault diagnosis and fault-tolerant 
control for NCS are different from the ones for traditional control systems 
in many aspects. For example, it is apparent that networked-induced delay, 



Y. Xia, M. Fu, and G.-P. Liu: Analysis and Synthesis of NCSs, LNCIS 409, pp. 159 -181 



springcrlink.com © Springer- Vcrlag Berlin Heidelberg 2011 



160 10 Fault Detection over Networks Subject 

packet dropout and other characteristics of networks could influence the per- 
formance of a fault diagnosis system designed without taking them into ac- 
count |33] . With some assumptions, the NCS was modeled as a simplified 
delay system, then many existing methods, such as state observer, filtering 
algorithm, etc., developed originally for ordinary time-delay systems could 
be used for or extended to fault diagnosis of NCS. Further, new algorithms 
dedicated to NCS have been presented based on these models. 

In control systems, faults are defined as a kind of latent disordered dynam- 
ics, which may occur at any part of control systems. Usually, sensor and actu- 
ator faults as a sudden offset or drift can all be modeled as additive changes in 
state (for example, see [35], [21]) or as unknown nonlinear functions (for ex- 
ample, see [1841 12341155] ). In addition, disturbances are traditionally modeled 
as additive state changes. In the current chapter, we model faults as abrupt 
changes in system states with unknown occurrence time and jump magni- 
tude. Hence, the fault detection problem in this chapter becomes estimation 
of the changes. Maximum likelihood (ML) estimation is a powerful tool for 
estimating the unknown parameters by maximizing the likelihood of given 
measurements. However, it is more popular to use the ratio of likelihoods 
under different hypotheses to estimate the unknown parameter (63) . As for 
estimating the occurrence time and magnitude of an unknown abrupt state 
change for linear systems, Willsky and Jones |196j proposed the generalized 
likelihood ratio test algorithm in time domain. In their method, a Kalman 
filter is applied to estimate the states under the hypothesis that there is no 
any state change occur, meanwhile the innovations of the Kalman filter are 
refiltered under the hypothesis that a change occurs at the hypothetical time 
instant with unknown magnitude to obtain the estimate of magnitude, then 
the estimate of occurrence time is solved by maximizing the likelihood ratio. 

This chapter proposes a fault detection and compensation scheme based 
likelihood ratios for networked predictive control systems with random time 
delay and clock asynchronism. A predictive control scheme based on state 
observer is designed to compensate the network time delay. Two schemes are 
proposed to update the fault estimation. One of them is conservative and it 
need a buffer to keep the data packet's sequence. The other one is without 
buffer, and the observer processes the packets in sequence, and it discard 
others. Hence, the likelihood ratios of fault are computed, and if a fault is 
detected and identified, the estimate of the fault is sent to the controller to 
compensate the fault. A numerical simulation is also given to validate the 
proposed method. 



10.2 Networked Predictive Control for Systems with 
Network Delay 

This chapter considers the case where the controller at the local node is far 
away from the plant and the manipulated variables and measured outputs of 
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plant are transmitted through networks with random time delay and clock 
asynchronism. The network delay in the feedback channel and forward chan- 
nel is bounded. The plant studied in this chapter is described by 

x(k + 1) = A(k)x(k) + B(k)u(k) + v(k) + o k - k ,v (10.1) 

y(k) = C(k)x(k)+e(k) (10.2) 

where x £ R" , y G R and u G R m represent the state variables, measured 
outputs and manipulated inputs, respectively. The additive fault v G R n 
enters at time kl as a step jump, where o~k denotes the unit step function. v(k) 
and e(k) are noises. Here v(k), e(k) and x(0) are assumed to be independent 
Gaussian variables: 

v(k) G N(0,Q{k)), e(k) G N(0,R{k)), x(0) G JV(0,ZT(0)) (10.3) 

Furthermore, they are assumed to be mutually independent. For the simplic- 
ity of stability analysis, it is assumed that the reference input of the system 
is zero. Also, the following assumptions are made. 

Assumption 10.1. The pair (A(k),B(k)) is completely controllable, and the 
pair (A(k),C(k)) is completely observable. 

Assumption 10.2. The sum of the upper bound of the network delay in the 
forward channel and the feedback channel is not greater than Ni, where N\ 
is a positive integer. 

Assumption 10.3. A buffer is set at the local node with length of N2, which 
is to gather the measured outputs transmitted from the sensors, where N2 is 
the upper bound of the network delay in the feedback channel. Note that if 
GLR with intermittent observation (proposed in Section \10.5\) is applied, this 
buffer is not needed. 

Assumption 10.4. Clock asynchronism exists between the local clock and 
the remote clock. 

In the rest part of this section, we present a predictive control scheme con- 
sidering the clock asynchronism and random time delay. Liu et al proposed a 
predictive control method to compensate for the network-induced time delay 
|107j QUE], but their method is not suitable for the system in this chapter 
since there is clock asynchronism exists. 

First, we explain why the predictive control method proposed by Liu et al 



[107 108 can not be applied in the current chapter. The predictive controller 
gives predictive control signals based on the measurements and the controlled 
plants model. Assume that at time instant k the clock of the controller (at the 
local node) reads k', there is a constant shift, denoted by 6, exists between 
k and k! ', i.e., k! + 5 = k, and the shift 5 = ±1,±2, • • • is unknown and can 
not be obtained easily since the time delay between the local node and the 
remote node is random. There are two cases needed to be considered: S > 
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and 8 < 0. First, if S > 0, then the local node receives the measured outputs 
with time stamp k at time instant k + Ab, but the clock at local node reads 
k + Ab — 8, where Ab denotes the time delay in the feedback channel of this 
transmission. As for the case Ab > 8, the controller treats the delay as Ab — 8, 
which is shorter than its real value. Thus the controller gives the predictive 
control signals not based on k, but k', i.e., Ufc/+i|*') * = 0, l,---. This set 
of control signal does not guarantee that the controlled plant is stabilized. 
On the other hand, if Ab < 8, then a serious logical error occurs since the 
controller receives the measured outputs before it is transmitted according 
to its clock. As for another case that 8 < 0, the analysis is very similar. In 
summary, the existence of clock asynchronism may incur some drawback even 
serious error in predictive control systems. 

Due to the latent asynchronism between the local clock and the remote 
clock and the existence of random delay in the feedback channel, we present a 
scheme that the controller and observer generate the estimates and predictive 
manipulated variables based on the remote clock time, namely, all the time 
information subscripts in this chapter denote the time shown by remote clock, 
thus the asynchronism can be ignored. See Fig. 110.11 a data packet with time 
stamp k is transmitted to the local node at time instant k (remote node clock 
time), and it arrives at the local node at time instant k + Ab (remote node 
clock time). Then the controller at the local node gives a set of predictive 
manipulated variables which is put into a forward data packet with time 
stamp k, and sends it to the remote node. The remote node receives the same 
packet at time instant k + Ab + Af, where Af is the time delay in the forward 
channel. According to the assumptions, we have Ab+Af < N\, the time delay 
compensator at the remote node chooses the newest Uk+A b +A f \hi where h is 
anyone available, as the input of the plant, thus the time asynchronism is 
canceled. 

Based on the scheme and analysis above, the networked control system 
considered in the current chapter is equal to a system, in which the data 
packets are transmitted from the remote node to local node without any 
time delay, and the data packets are transmitted from the local node to the 
remote node with random time delay Ab + Af. 

Since the networks time delay is random, the data packet transmitted may 
be out of sequence. As aforementioned Assumption 110.31 a buffer of length 
N2 is set at local node and the measured outputs arrived at local node are 
stored in the buffer. The observer chooses the measured observations from the 
buffer according to the sequence in which the measured outputs are sampled 
by sensors. For example, after the measured output y(k) is processed, the 
buffer deletes the same measured output, and the observer searches the next 
measured output y(k + 1) from the buffer, if y(k + 1) is not available in the 
buffer, then the observer holds on, and searches the same one at the next step, 
and if y(k + 1) is available, then the observer uses it to update. This kind 
of application is to ensure the observations are processed by their intrinsic 
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Remote node 



Feedback data packet 



Time stamp: k Measured observation: y(k) 



Local node 



Forward data packet 



Time stamp: k 



Predictive manipulated variables: 

u(k + l\k),...,u(k + N i \k) 



Fig. 10.1 Both feedback and forward data packets are with a same time stamp. 



order. However, an alternative method does not process those observations 
out of sequence. 

First, the state observer is designed as 



x(k + 1|A) = A(k)x(k\k - 1) + B(k)u(ok) + L(k)e(k) 



(10.4) 



where x(k + l\k) G R n and u(ok) £ R m are the one-step ahead state 
prediction and the input of the observer at time k, respectively. e(k) = 
y(k) - C(k)x(k\k - 1) is innovation. The matrix L(k) = A{k)M{k) G R nxl 
can be designed using observer design approaches. 
The estimator of the state is 



x(k\k) = x(k\k - 1) + M(k)e{k) 

where M{k) is filter gain, and it can be obtained by 

S(k) = C(k)P{t\t - l)C{k) T + R(k) 
M(k) = P(k\k - l)C(fc) T 5(fc)- 1 
P(k + l\k) = A(k)[P(k\k - 1) - M(k)C(k)P(k\k ~ l)]A(k) T 
+Q(k) 



(10.5) 



(10.6) 

(10.7) 

(10.8) 



where P(k + l\k) is covariance of estimate before the measurement y(fc + l) is 
processed, and (|10.5(1 - (|10.8(1 is obtained easily from the famous Kalman filter 
equations. 

Following the state observer described by (|10.4|1 . based on the output data 
up to k, the state predictions from time k + 1 to k + N\ are constructed as 
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x{t + l\t) = A(k)x(k\k - 1) + B(k)u(ok) + L(k)(y(k) - C(k)x(k\k - 1)) 
x(k + 2\k) = A(k + l)x(k + l\k) + B(k + l)u(k + l\k) 

xik + N^k) = A(k + N ± - l)x(k + N x -l|fc) 
+B(k + Ni- l)u(k + N X - l|fc) 

(10.9) 

The gain of feedback controller, Kj., can be designed based on the modern 

control theory in the case of no delay, for example, Linear Quadratic Gaussian 

(LQG), eigenstructure or pole assignment, H2 and Hoc in the presence of 

disturbance, etc. The predictive manipulated variables are calculated by 

u{k + i\k) = K(k + i)x(k + i\k), i = 0, 1, ..., iVi (10.10) 

and it follows from equation (|10.9p that 

k+i—l 

u(k + i\k) = K(k + i) Yl (A{h) + B(h)K(h))x(k\k), 



h=k 



*=l,2,...,JVi (10.11) 



At every step, the controller sends a set of predictive manipulated variables 
in a data packet: 

{u(k + i\k) I t = 0,l,...,JVi} 

while at the remote node, a compensator is designed to choose a predictive 
manipulated variables to plant as the actual manipulated input from it's 
receiving buffer: 

u(k) =u(k\k-i) (10.12) 

where 

i = min {i I u{k\k — i) has arrived at the remote node buffer.} 

From the above, it is shown that in the case of no network delay in the 
communication channel, the input to the plant actuator is the output of 
the controller. In the case of a delay iT, where T is the sampling period, the 
control input to the actuator is the ith-step ahead control prediction received 
in the current sampling period. 



10.3 Stability Analysis of Closed-Loop Systems 

In the fault free and disturbance free case, namely, v(k) = and v = 0, the 
stability of closed-loop system will be proved in this section. Use predicted 
value as the control input to actuator: 

u{k) = K(k)x(k\k-i) (10.13) 
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K(k) 



ii(k\k),...Mk+N 1 \k 



u(k\k) 



observer 




compensator 



y(k) 



u(k\k-i) 



plant 



controller 



Fig. 10.2 Structure of proposed control method for networked predictive control 
systems. 



while the control input to the observer is 

u{ok) = u(k\k) = K(k)x(k\k) 



(10.14) 



where K(k) £ R m >< n } s the state feedback control matrix to be determined 
using modern control theory. Fig. ll0.2l shows the structure of proposed control 
method for networked predictive control systems. 

Remark 10.1. In some research works, the actual inputs u{k) of plant are 
assumed to be sent back to the local node without time delay, thus the actual 
inputs and outputs of plant are available for observer. However, this scheme 
can not be easily applied in practice, so it is assumed in this chapter that the 
actual inputs u(k) of plant can not be sent back to the local node, and are 
also not available for observer. 



Thus, it follows from equation (|10.4p ? that 



k+i 



x(k + i\k) 



Yl (A(h)+B(h)K(h))x(k + l\k) 

h=k+l 



(10.15) 



Based on equations (|10.1[) . (|10.2|) and (|10.4[) . it can be shown that 



x(k + i\k) 

k+i 

Yl (A(h) + B(h)K{h)) (B(k)K(k)M(k)C(k) + L(k)C{k)) x{k) 

h=k+l 
k+i 

+ J] (A(h) + B(h)K(h)) 

h=k+l 

x(A(k) + B(k)K{k) - L(k)C(k) - B(k)K{k)M{k)C(k)) 
xx(k\k-l) (10.16) 
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u{k + i\k) 

k+i 

= K(k + i) "[I (A(h)+B{h)K(h))(B(k)K(k)M(k)C(k)+L(k)C{k))x(k) 

h=k+l 
k+i 

+K(k + i) Yl (A(h) + B(h)K(h)) 

h=k+l 

x(A(k) + B(k)K(k) - L(k)C(k) - B(k)K(k)M(k)C(k)) 

xx(k\k-l) (10.17) 

Theorem 10.2. For the networked predictive control systems with random 
network delay, the closed-loop system described by \10.J$ , H10.ll]) and MO. 1 Sty 
is stable if there exists a positive definite matrix P <E R^N 1 +2)nx(2N 1 +2)n guc ^ 
that 



A T {i)PA{i) - P < 



for i = 0, 1, 2, • • • , Ni, where 
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Mi(i) 
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With i e {1, 2, • • • , iVl}, A(i) G J R2(W 1 + l)r l x2(JV 1 + l)n ; 



(10.18) 



(10.19) 



A'h(i) = B(k)K(k) Y\ ( A ( h ) + B{h)K{h)) 

h=k-i+\ 

x (B(k - i)K(k - i)M(k - i)C{k -i) + L(k - i)C(k - i)) 
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M 2 (i) = B{k)K{k) Yl ( A (h) + B{h)K{h)) 

h=k-i+l 

x (A(k -i) + B(t - i)K(t - i) - L(t - i)C(t - i) 

- B(t - i)K(t - i)M(t - i)C(t - i)) 
M 3 (i) = B(k)K(k)M(k)C(k) + L(k)C(k) 
M 4 (i) = A(k) + B(k)K(k) - L(k)C(k) - B(k)K(k)M(k)C(k) 
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(10.20) 



Mi(0) = A{k) + B(k)K(k)M(k)C{k) 

M 2 (0) = B(k)K(k) - B(k)K(k)M(k)C(k) 

M 3 (0) = B(k)K(k)M(k)C(k) + L(k)C(k) 

M 4 (0) = A(k) + B(k)K(k) - L(k)C(k) - B(k)K(k)M(k)C(k) 

Proof. Since the control input to the actuator of the plant is u(k) = 
K(k)x(k\k — i), then, based on (J10.17J) . the closed-loop system can be written 
as 



x(k + 1) = A(k)x(k) + B(k)u{k) 

= A(k)x(k) + B{k)u\k\k - i) 
= A(k)x(k) + M t (i)x(k - i) 

+ M 2 (i)x(k - i\k - i - 1) 



(10.21) 



Since the control input to the observer is u(ok) = u(k\k) — Kx(k\k), then, 
based on (|10.4p . the state observer has the following form 



168 10 Fault Detection over Networks Subject 

x(k + l|fc) = A(k)x(k\k - 1) + B{k)u{k\k) 

+ L(k)(C(k)x(k)~C t x(k\k~l)) 
= (A(k) - L(k)C(k))x(k\k - 1) + L(k)C(k)x(k) (10.22) 

+ B(k)K(k)(x(k\k - 1) + M t (y(fc) - C(k)x(k\k - 1))) 
= M 4 (i)£(A;|fc - 1) + M 3 (i)x(k) 

Let 

x T (fc) = [x T (fc) a; T (fc - 1) • • ■ x T (fc - i) x T (k - (i + 1)) 

• ■ ■ x T (fc - JV) x T (fc|fc - 1) x T (k - l|jfc - 2) • • • (10.23) 

■ ■ • x T (fc - i|fc - i - 1) • • ■ x T (k -N\k-N- 1)] 

then, the augmented system can be expressed as 

x(k + 1) = A(i)x(k) 

When i = 0, based on (|10.16|l . the augmented system can be expressed as 

x{t + 1) = A(0)x(k) (10.24) 

It follows that the closed-loop system is a switched system which is composed 
of N% + 1 discrete-time subsystems, i.e., 

x(k + l)=A(i)x(k) (10.25) 

where i = 0, 1, • • • ,N\. The switched system can be described as 

x(t + l)=A s(k) x{k) (10.26) 

where 5(k) : {0, 1, • • •} — > {0, 1, 2, ■ • • , iVi}, 8(h) is switching signal. 
Let V(k) =x T (k)Px(k), then 

V(k + 1) - V(fc) = S T (fc + l)Px(k + 1) - x T (k)Px(k) 

= x T {k)[A T s{k) PA s{k) - P]x T {k) (10.27) 

From (|10.18[> . it follows that V(A + 1) - V(fc) < 0, for 5(fc). Therefore, system 
(|10.26[) is stable for all switching sequences S(k). 

10.4 Fault Detection and Identification Based on 
Likelihood Ratios 

The likelihood ratios (LR) test is a multiple hypotheses test, where the dif- 
ferent fault hypotheses are compared to the no fault hypotheses pairwise. In 
the LR test, the fault magnitude is assumed to be known. The hypotheses 
under consideration are 
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H : no fault 

Hi(k' , v): a fault of magnitude v at time k! . 

The log likelihood ratio for the hypotheses as the test statistic: 

lN{k ' V) = 2l ° 9 P (y»\H ) = 2l ° 9 P (y"\k> = N) (1 °' 28) 

where the factor 2 is for notational convenience, and y N denotes the set of 
measurements y(l), 2/(2), ..., y{N). In this chapter, we use the convention that 
Hi(N, v) = Ho, so again, k' = N means no fault. Then the LR estimate can 
be expressed as 

a ML 

k' = axgmaxl N (k',u) (10.29) 

k' 

when fault magnitude v is known. However, the fault magnitude v is assumed 
to be unknown in this chapter, so a double maximization over k' and v called 
Generalized Likelihood Ratio (GLR) proposed by Willsky and Jones |196| is 
given to estimate the fault: 

i>{X) = „rgmax2fo<,-^^L (10 .30) 

where v{k') is the maximum likelihood estimate of v, given a fault at time 
k' . The fault candidate k! in the GLR test is accepted if 

l N (k',v(k')) >h, 

where the threshold h is a parameter to be tuned. The key point of GLR test 
is that the innovation from the state observer can be expressed as a linear 
regression in v, 

e k ,(k) = <pl,(k)p + e(k) (10.32) 

where £&< (fc) is the actual innovation from the state observer if v and k' 
are known, e(k) is the virtual innovation of system (110. ip without additive 
fault. Before the fault occurs, the actual innovation is equal to the virtual 
innovation: 

£k'{k) =e{k) 

and the innovations get a bias, 

e(k)eN(0,S(k)) 

that means 

<pv(k) = 0, fc' = 0,l,...,fc 
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However, given a fault v at time k' , the innovations get a bias, 

e k r(k)GN(ip kl (k)u,S(k)), 
and the regressors ip k > (k) can be computed using 



fl{k) = C{k) 



t-i 



l[A(h)-A(k-l)w(k) 



,i= k 



l£(k + 1) = A(k)n k ,(k) + M(k + l)ifil(k), 

initialized by zeros at time k — k'. Here <p(k) £ R n and /i(fc) £ R nxn . 
At the time k' = N, the test statistic is given by 

l N (k',P(k')) = g,(N)R^ l (N)f k ,(N) 

where the linear regression quantities are 



(10.33) 
(10.34) 

(10.35) 

(10.36) 
(10.37) 



i=l 

k 

1=1 
for each k' , 1 < k' < k. A change candidate is given by 

k! = argmaxZjv(£;', v{k')) 

It is accepted if ^(k'^^k')) is greater than some threshold h (otherwise 
k' = N) and the corresponding estimate of the change magnitude is given by 

N (k') = R^(N)f g (N). 

The formulation (|10.35|) is off-line. Since the test statistic involves a matrix 
inversion of -R(iV), a more efficient on-line method is as follows, 

l k (k',i>(k , )) = f k r ,(k)h'(k) 

where k is used as time index instead of N. v k i (k) can be updated recursively, 
eliminating the matrix inversion of R k i{k). 

However, in real applications, because of the observed signal is too large, 
the memories required to restore the computed data is square increasing, and 
computation time increases step by step, so setting a suitable data structure 
becomes important. In this chapter, we recommend a trade-off windowed 
on-line GLR method if the FDI system is with limited computation capacity: 



l k {k - W, v(k - W)) = f^_ w {k)v k ^ w {k) 



(10.38) 
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where W is the length of data window. Better performance of estimate can be 
obtained if a larger W is chosen, however, a larger W means that much time 
is needed for detecting a fault after it occurs. Computing i>k-w(k) recursively 
needs data from step k — W to k, so that the computing time of every step 
is fixed. 

From (|10.32[) . we can know that the innovations from the state observer 
are the linear combinations of fault is, so that the Recursive Least Squares 
(RLS) algorithm can be used to estimate the fault v for each time k 1 : 

M*) = h>(k - 1) + K"(k)[e(k) - <pl,{k)i>k'(k - 1)] (10.39) 

K{k) = x + ^(k)p(k-i)^(k) (10 ' 40) 



P(k) = T [P(k 1) - „ ", U J, K tt A 



1 \p(k 1) p(fc " 1} 

+<pl(k)P(k-l)<p k ,(k)} (10.41) 



where the design parameter A is called the forgetting factor. 

If the windowed likelihood ratios estimate i>k-w(k) is greater than the 
threshold, the fault detection 



*>(#).#) ={v k -w{k),k-W) 



is sent to the predictive state observer to compeansate the fault. From the 
time k', the predictive state observer (|10.4|l is modified to: 

x(k + l|fc) = A(k)x(k\k - 1) + B{k)u(ok) + L(k)e(k) + v(k'), (10.42) 

and the state predictive equation and predictive manipulated variables equa- 
tion are modified as follows 

x(k + l|fc) = A(k)x(k\k - 1) + B(k)u(ok) + L(k)e(k) + u(k') 
x(k + 2\k) = A(k + l)x(k + l\k) + B(k + l)u(k + l|fc) + O(k') 

: (10.43) 

x(k + Ni\k) = A(k +Ni- l)x(k + Ni- l\k) 

+B(k +N X - l)u(k + JVi - l|fc) + v{P) 

and the predictive manipulated variables are as follows, 

u(k + i\k) = K(k + i)x(k + i\k), i = 0, 1, ..., N\ 

From the above, the recursive computing equations of predictive states and 
predictive manipulated variables are given as follows 
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(10.44) 



Fig. ll0.3l sliows the structure of proposed FDI method for networked predic- 
tive control system. The likelihood ratios are computed according to (|10.38[> - 
(|10.4ip step by step. When the log likelihood ratio is greater than a given 
threshold, the estimate of the fault is sent to the controller, the state observer 
compensates the fault immediately. 



controller 



(vX) 



FDI 




compensator 



v«) 



U (k) 



plant 



Fig. 10.3 Structure of proposed FDI method for networked predictive control 
system. 



Remark 10.3. Note that after a fault is detected, the controller compensates 
the fault according to (|10.44|) . If the fault estimate converges at its true value, 
the state estimates converge at their true value. However, since the existence 
of network time delay and the data window size W , the additive fault keeps 
its effect on the system state for a period of time after compensation, the 
states and the measured outputs converge at another stable points after fault 
compensation. 



10.5 GLR with Intermittent Observations 



In the previous section, a buffer is set at the local node to save the observation 
packets which are out of sequence. The observer processes the observations 
according to the sequence in which the remote node sends the packets. This 
method is easy to be applied, but with some drawbacks. First, though an 
observation is available for the observer, it is not processed until all the 
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previous observations have arrived at the local node and been processed. It 
costs much more time to detect a fault after it occurs. Secondly, if there is 
no any observation packet need to be processed at some time instants, the 
observer is idle. On the contrary, the computation burden is heavy at some 
time instants when there are many packets need to be processed. Thirdly, 
the additional buffer increase the hardware cost. 

An alternative scheme for the local node is to process the observations 
without buffer. In this case, when an observation packet arrives at the local 
node, the observer checks the time stamp of this packet, if this time stamp is 
greater than every time stamp of the packets which has already arrived at the 
local node, the observer processes it; if the time stamp is not the newest at 
the present time instant, the observer discards it and treats the observation 
as zero. First, the state observer is designed as 

x(k + l|jfe) = A(k)x(k\k - 1) + B(k)u{ok) + 1 {k)L(k)e{k) (10.45) 

where j(k) = {0, 1} denotes whether the observation with time stamp k is 
processed or is discarded, which is with probability distribution p 7 ( fc )(l) = A. 
Note that a similar description of j(k) is presented in much literature to de- 
note whether the data is transmitted successfully. The meanings of these two 
descriptions of j(k) are different from each other, but same in mathematical 
analysis. 

Now we give the convergence analysis of GLR with intermittent obser- 
vations. However, the work of this section is limited to LTI (linear time- 
invariant) systems. First, by minimizing the following loss function, 

k 

VkM = £ 7 (t) (e(«) ~ <p{tfv) T Sit)- 1 (e(«) - <p(tfv) (10.46) 

t=i 

we have the least square estimate with intermittent observations: 

v{k) = i>(fc-l)+ 7 (fc)(i? ¥ '(fc))-V(fc)5'(fc) _1 (e(*0 - v{k) T v{k - 1)) (10.47) 

where i? v (fc) = Ylt=i < P(t)S(t)~ 1 (p(i) T . This is the recursive update for esti- 
mate, we also can obtain the update of R v (k): 

Rf(k) = R v (k - 1) + 7 (fc)<p(fc)S(fc) _ V(*0 T (10.48) 

Let P(k) denotes the covariance matrix of v, according to [63], we have 
P(k) — (R v (k))~ x . The famous matrix inversion lemma applied to (| 10.48)) 
gives 

P(k) = P(k-l)-- 1 (k)P(k-l)ip(k)[if(k) T P(k-l) l f(k)+S(k)}- 1 ip(k) T P{k-l) 

(10.49) 
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Now, we define a function 

gxA x ) =X- \X<p(k)((p(k) T Xip(k) + S{k))- l ip{k) T X (10.50) 

From (|10.50[) . we have g\ t k(X) < X, Vfc, X. Now, we state some properties 
of function (|10.50p as following lemmas: 

Lemma 10.4. For a LTI system described in ilU.l]) . where A{k) = A, 
B(k) = B, C(k) = C, Q{k) = Q, R(k) = R, \/k, let \(A) denote the eigen- 
values of matrix A, and M denotes the solution of the following equation: 

M = AMA T - AMC T (CMC T + Ry l CMA T + Q (10.51) 

If |A(A)| < 1 and \X(A — MCA)\ < 1, then the limit of regressors <fk(t) exists, 
k = t, t + 1, • • •, yt, which is described as follows: 

V T k (t) = C[A k - t ~A^ k (t)} (10.52) 

H k+1 {t) = A^ k {t) + M(k + l)ifl{t) (10.53) 

where M{k) is Kalman filter gain, and 

lim ipl(t) = (I- MC){I - A)-\ (10.54) 

k — >oo 

Proof. Assume that t = without loss of generality, we have the following 
equation from (|10.1[) : 

fe+i fc+i 

x{k + 1) = A k+1 x{0) + J2 A k+1 - l v{i) + J2 A k+1 -' l v (10.55) 

i=l i=l 

and from the Kalman filter equations, we have 

x(k\k) = (A- M(k)CA)x(k - l|fc - 1) + M(k)CA k x(k) 

k k 

+M(k)C J2 A k -' l v{i) + M{k)C^A k - l v + M(k)e(k) 
i=l i=l 

the alternative Kalman filter which is assumed to have the information of the 
fault gives 

x (k\k) = (A - M(k)CA)x (k - l|fc - 1) + M (fc)CA'x(O) 

k k 

+M{k)C^A k ~ l v(i) + M(k)C J2 Ak ~ ly 

i=l i=l 

k 



+M(k)e(k) + (I - M(k)C) ^ A k ~ l v 
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thus we define that the error between these two filters is x(k): 
x(k) = Xo(k\k) — x(k\k) 

k 

= (A- M{k)CA)x(k - 1) + (J - M(k)C) Y^ A k ~ l v. (10.56) 

8=1 

From the concept of ip£ (f) and (|10.56[) , we have 

lim ifo(k)v = lim x(k) (10.57) 

k — >oo k — >oc 

Since |A(A)| < 1, the steady state Kalman filter gain M — limfc — * ooM(k) 
exists and is found by solving: 

M = AMA T - AMC T (CMC T + R^CMA 7 + Q 

Because \X(A - MCA)\ < 1, the first term of the right side of (|10.56() will 
approach to zero when k — > oo. For the second term of the right side of 
(|10.56p , we need to analyze the existence of limit of the following equation: 



k 

k— >oo * 



lim V A fc 



1=1 



Without loss of generality, we assume that all eigenvalues of A are distinct. 
Then we can factorize A = T~ 1 AT J where A is a diagonal matrix with diag- 
onal elements being the eigenvalues. Then 



k / k \ 

lim Vf-' = T- 1 lim V yl fc - J 

fe^oo ^-^ \ fe^oo ^-^ / 

1=1 \ 1=1 / 



T 



= T _1 (J + A + A 2 + ■ ■ ■ + A 1 + ■ ■ -)T 
= T _1 (J - A)~ l T 
= ^T-\I-A)T)~ X 

= {I-A)- 1 

Then, the limit of the regressor exists 

lim <pl(t) = (I - MC){I - A)' 1 

k — >oo 

Lemma 10.5. [1691 Consider the function 

g\, k {X) = X - XXip(k)(ip(k) T Xip(k) + S(fc))-V0) T ^- (10.58) 
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Assume X,S(k) e § = {S e R nxn \S > 0}, and < A < 1. Then, the 
following facts are true. 

l)IfX< Y, then g x . k (X) < g x , k (Y). 
2)IfX> gx, k (X), then X > 0. 

3) Let X k+ i = g x ,k{X k ), if X x > X , then X k+1 > X k , and if Xi < X , 
then X k+ i < X k . 

Now, we formally state the convergence analysis of GLR with intermittent 
observations as the following theorem: 

Theorem 10.6. For a LTI system described in A10.1\) . where A(k) = A, 
B(k) = B, C(k) = C, Q{k) = Q, R(k) = R, Vfc, let \(A) denote the eigen- 
values of matrix A, if \\{A)\ < 1, then the GLR estimation covariance P{k) 
with intermittent observation is bounded and for any P(0) there exists P = 
independent of P(0) such that 

lim P(k) = P (10.59) 

t — >oc 

Proof. From (|10.49|) . we have 

P(0) > P(l) > • • • > P(k) >■■■ 

thus, for any fc, < P(k) < P(0), that means for any initial condition 
P(0) > 0, P(k) is a monotonically decreasing sequence with a lower bound 
0. According to Dedekind theorem, the sequence converges at a finite matrix. 
Let P denotes the limit of P(k), we have 

P = lim si k (P(0)) = lim gl k (P(k)) (10.60) 

Substituting (|10.60|) to (|10.59[) gives 

Pip(<f T P<f + S)- 1 >p T P = 

where (p and S denote the limits of <p k (t) and 5(fc), respectively, for any 
t, when k approaches infinity. According to Lemma \l 0.41 (p exists and does 
not always equal to zero. Sinopoli et al proved that if A is stable, the state 
covariance P(k\k) is convergent when k approaches infinity [169) . namely, S 
exists and 

S = CA ( lim P(fc|jfc) J A T C T + C T QC + R>0 
This implies that the term 

<p((p T P(p + B)- 1 ^ 

does not always equal to zero, which proves that P = 0. 
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10.6 Numerical Simulation 



In this section, in order to validate the proposed method, a servo motor 



control system [110] that consists of a DC motor, load plate, speed, and 
angle sensors is considered. The model of the motor control plant at sampling 
period 0.04s is identified to be 



Giz- 1 ) 



0.05409z- 



0.115z- 3 + 0.001z" 4 



1- 1.12,2- 



0.213z" 



0.335z- 



(10.61) 



The system can also be written as the state space form with the following 
system matrices 



A = 



1.12 0.213 -0.335 
1 

1 



D 



,C = [0.05410.1150 0.0001] 
The state feedback matrix K is designed to be 



K 



0.027 0.575 0.0001 



which ensure that the close-loop system without time delay is stable. In this 
simulation, the upper bound of network time delay N\ — 4 and the data 
window size of GLR is W = 5, the fault occurs at time k' = 20 and its 
magnitude is v = [8 0] T . 

The threshold h = 2000, and as Fig. 110.41 shows, the fault detected is 
(i>(k'), k') = (7.98, 26). Note that if the threshold is designed to be smaller, 




5 10 15 20 25 30 35 40 45 50 55 
Time (k) 



Fig. 10.4 Test statistics with fault compensation of numerical simulation in this 
chapter. 
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the k' is closer to its true value k', but the estimate of fault departure its 
true value, so a suitable threshold should be designed considering the trade-off 
between the precision of estimated k' and estimated v. Fig. ll0.5l shows the test 
statistics without compensation of this simulation, the log likelihood ratios 
do not converge at zero after the fault is detected without compensation. 




estimate of v(k) 



10 15 20 25 30 35 40 45 50 55 
Time (k) 



Fig. 10.5 Test statistics without fault compensation of numerical simulation in 
this chapter. 



Fig. 110.61 shows the states and their estimates with fault compensation 
in this simulation, the estimates departure from their true values when the 
fault occurs at k = 20, and after the fault is detected and compensated, the 
estimates of states converge at their true values. Fig. 110.71 shows the actual 
inputs and their corresponding outputs with fault compensation. 
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Fig. 10.6 The states and their estimates with fault compensation of this simulation. 
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Fig. 10.7 The inputs and outputs with fault compensation of this simulation. 



10.7 Discussion 



Network-induced time delay is the key issue in the investigation of NCS. Gen- 
erally speaking, there are two delays, sensor to controller delay (or delay in 
backward channel) and the controller to actuator delay (or delay in forward 
channel). These two delays can be combined together when the controller 
is linear and time-invariant. It is shown in |214| . that the network- induced 
delay will prevent a traditional observer based fault detection system from 
satisfying the essential requirement of a qualified residual generator, i.e., with 
the delay, the residual signal of a traditional residual generator will not be 
able to be decoupled from the control input any longer. To solve this prob- 
lem, some methods are proposed. If the network-induced time delay of an 
NCS is unknown and smaller than the sampling period, then the NCS with 
disturbance and latent fault can be described as a system without any time 
delay, and the affect of time delay is modeled as an unknown input item [229 . 
The fault diagnosis system should be robust to this term, and some schemes 
are developed recently. For example, traditional parity relation based low- 
pass post filtering residual generator for NCS with network-induced delay is 
proposed in |217j to reduce the influence of the unknown input item. As for 
the case when the delay time is greater than one sampling period, the tradi- 
tional robust methods do not have good performance since the influence of 
the unknown input item caused by time delay is great. Huang and Nguang 
proposed an observer based fault detection scheme for NCSs with network- 
induced time delay and data packet dropout [79], wherein the lengths of 
delay are not limited to be smaller than sampling period, but bounded. They 
also treated the time delays as time- varying input delays, and developed new 
disturbance attenuation notation according to the H^ performance. There 
are two kinds of nuisances needed to be attenuated in the FDI systems, one 
is disturbance or unmodcled dynamics; the other is unknown inputs caused 
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by time delay. In the current chapter, the proposed predictive method faces 
only one nuisance, and the influence of network-induced time delay is totally 
compensated theoretically. 

As mentioned above, predictive control is a good choice to design the 
FDI scheme without considering attenuating the influence of network-induced 
time delay, but it need the observer and controller work according to time 
precisely. Much literature has not paid attention to this practical problem, 
and its methods of predictive control have nice performance only in theory. 
Estimating the clock asynchronism is not easily applied in practice when the 
network-induce time delay is unknown and random, the proposed scheme of 
using the time stamps in the measurements data packets is suitable and easy 
to be carried out. Furthermore, it converts a NCS with time delays both in 
the backward channel and in the forward channel to an equivalent system 
with time delay in the forward channel if the controlled plant is linear. It is 
easy to analyze the stability of the NCS and to design controller. On the other 
hand, this scheme involves heavier computation burden since the controller 
has to extend the predictive horizon to make it longer then the sum of the 
maximum of time delays in two channels. 

Two schemes for updating the likelihood ratios for the latent fault are also 
proposed in the current chapter. One is to set up a buffer at the local node 
to gather measurement data packets to keep them be processed in sequence, 
i.e., an observation is processed after all other observations are processed, 
which are sampled by sensors earlier than the observation. This method is 
conservative and easy to give an analysis of stability. The other scheme is 
to process the intermittent observations that are in sequence and discard 
the observations that are out of sequence. Based on this scheme, the NCS 
with random network-induced time delay is modeled as a NCS with data 
packet dropout. Xiao et al proposed a peak covariance stability analysis of 
time-varying Kalman filter with possible packet losses in transmitting mea- 
surement outputs to the filter via a packet-based network 208 . It is shown 
that if the observability index of the discrete-time LTI system under investi- 
gation is one, the Kalman filter is peak covariance stable under no additional 
condition. In the current chapter, updating likelihood ratios of the latent fault 
with intermittent observations is converted to the least square problem with 
intermittent observations. The result shows that GLR test with intermittent 
observations is convergent if the state transfer matrix and the covariance ma- 
trices of noise satisfy a proposed condition. However, there is still limitation 
exists. For example, the latent fault must be a step type function, and the 
convergence analysis of GLR test with intermittent observations is only for 
LTI systems. 



10.8 Summary 

A fault detection and compensation scheme based on likelihood ratios for 
networked predictive control systems with random network time delay and 
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clock asynchronism is proposed in this chapter. The networked control system 
is stabilized by designing a state feedback gain and sets of predictive manip- 
ulated variables. The measured outputs are sent back to the local node. The 
likelihood ratios of fault are computed step by step, and if a fault is detected 
and identified, the fault estimate is sent to the controller to compensate the 
fault. Two methods are proposed for the local node to update the estimates. 
One of them is to process the observations according to the sequence in which 
the observation packets are sent from the remote node. The other method is 
to process the observations if they are the newest, and discard the other ob- 
servations. However, the convergence analysis of the second method is limited 
to LTI systems. A numerical simulation shows that after the fault is detected 
and compensated with the proposed scheme, the states estimates converge 
at their true value again. 
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